2024-03-23T23:40:19.301 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-23T23:40:19.301 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414 --owner mchangir --name mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} --verbose -- /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/orig.config.yaml 2024-03-23T23:40:19.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T23:40:19.425 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414 branch: wip-mchangir-testing-main-20240318.032620 description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} email: mchangir@redhat.com first_in_suite: false job_id: '7616414' kernel: flavor: default kdb: true sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-main-20240318.032620 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-main-20240318.032620 sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 owner: mchangir priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 3550 sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 sleep_before_teardown: 0 subset: 613/1024 suite: fs suite_branch: wip-mchangir-testing-main-20240318.032620 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4lwNX5QNvT+pyLOZV5EIjD1xOiWfDXLXOaViQ6vqUR514pjgAXowOqHA9uB83z9/u0NNnRcdYmfBwQWWSuaiA= smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwSqqx5Cmv0r6+LNQpDN2JYWJ+7vWjx9kOmMGrUozalGrHbQGtQzNhDMsWkK0qDLABIubMln60gk+mcLAf8qfU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - workunit: clients: client.0: - client/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-22_09:49:57 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-23T23:40:19.426 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa; will attempt to use it 2024-03-23T23:40:19.427 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks 2024-03-23T23:40:19.427 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-23T23:40:19.428 INFO:teuthology.task.internal:Checking packages... 2024-03-23T23:40:19.452 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3be9a5c9bc793e11e2800a8c0c696e8b46742033' 2024-03-23T23:40:19.452 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-23T23:40:19.453 INFO:teuthology.packaging:ref: None 2024-03-23T23:40:19.453 INFO:teuthology.packaging:tag: None 2024-03-23T23:40:19.453 INFO:teuthology.packaging:branch: wip-mchangir-testing-main-20240318.032620 2024-03-23T23:40:19.453 INFO:teuthology.packaging:sha1: 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:40:19.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-main-20240318.032620 2024-03-23T23:40:19.602 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2145.g3be9a5c9 2024-03-23T23:40:19.604 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-23T23:40:19.609 INFO:teuthology.task.internal:no buildpackages task found 2024-03-23T23:40:19.609 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-23T23:40:19.654 INFO:teuthology.task.internal:Saving configuration 2024-03-23T23:40:19.669 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-23T23:40:19.675 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-23T23:40:19.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:35:47.590605', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4lwNX5QNvT+pyLOZV5EIjD1xOiWfDXLXOaViQ6vqUR514pjgAXowOqHA9uB83z9/u0NNnRcdYmfBwQWWSuaiA='} 2024-03-23T23:40:19.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:35:47.592425', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwSqqx5Cmv0r6+LNQpDN2JYWJ+7vWjx9kOmMGrUozalGrHbQGtQzNhDMsWkK0qDLABIubMln60gk+mcLAf8qfU='} 2024-03-23T23:40:19.715 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-23T23:40:19.720 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-23T23:40:19.720 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-23T23:40:19.721 INFO:teuthology.run_tasks:Running task console_log... 2024-03-23T23:40:19.802 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f17a58f8e50>, signals=[15]) 2024-03-23T23:40:19.803 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-23T23:40:19.809 INFO:teuthology.task.internal:Opening connections... 2024-03-23T23:40:19.809 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:40:19.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:40:19.934 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:40:19.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:40:20.046 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-23T23:40:20.052 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-03-23T23:40:20.070 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-03-23T23:40:20.071 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T23:40:20.128 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-03-23T23:40:20.129 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T23:40:20.129 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T23:40:20.129 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T23:40:20.129 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-03-23T23:40:20.149 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-03-23T23:40:20.168 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-03-23T23:40:20.168 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-03-23T23:40:20.226 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T23:40:20.227 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T23:40:20.228 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T23:40:20.228 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-03-23T23:40:20.249 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-23T23:40:20.259 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-23T23:40:20.278 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-23T23:40:20.279 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-03-23T23:40:20.282 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-03-23T23:40:20.299 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-23T23:40:20.305 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-23T23:40:20.305 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-03-23T23:40:20.339 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-03-23T23:40:20.369 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-23T23:40:20.433 INFO:teuthology.run_tasks:Running task kernel... 2024-03-23T23:40:20.452 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'} 2024-03-23T23:40:20.452 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'}}, timeout 300 2024-03-23T23:40:20.452 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-23T23:40:20.453 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-23T23:40:20.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:40:20.470 DEBUG:teuthology.task.kernel:sha1 for mon.a is 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:40:20.470 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5ec3e6e88b2e2783e09498588bb1f433ae9c8986"... 2024-03-23T23:40:20.471 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-03-23T23:40:20.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:40:20.472 DEBUG:teuthology.task.kernel:sha1 for mon.b is 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:40:20.472 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5ec3e6e88b2e2783e09498588bb1f433ae9c8986"... 2024-03-23T23:40:20.472 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-03-23T23:40:20.528 INFO:teuthology.orchestra.run.smithi031.stdout:5.14.0-361.el9.x86_64 2024-03-23T23:40:20.528 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:40:20.528 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-23T23:40:20.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:40:20.532 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-361.el9.x86_64 2024-03-23T23:40:20.532 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:40:20.533 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-23T23:40:20.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:40:20.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum upgrade -y linux-firmware 2024-03-23T23:40:20.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum upgrade -y linux-firmware 2024-03-23T23:40:22.813 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-23T23:40:22.839 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-23T23:40:24.397 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - BaseOS 4.7 MB/s | 2.0 MB 00:00 2024-03-23T23:40:24.490 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-03-23T23:40:25.504 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-23T23:40:33.412 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 959 kB/s | 8.0 MB 00:08 2024-03-23T23:40:35.491 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-03-23T23:40:39.917 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.1 MB 00:00 2024-03-23T23:40:41.232 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 16 kB 00:00 2024-03-23T23:40:43.369 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-03-23T23:40:47.127 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 939 kB/s | 19 MB 00:20 2024-03-23T23:40:48.441 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-23T23:40:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-23T23:40:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-23T23:40:50.718 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 1 Package 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 375 M 2024-03-23T23:40:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-23T23:40:51.811 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 6.1 MB 00:01 2024-03-23T23:40:53.245 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 16 kB 00:00 2024-03-23T23:40:57.405 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 21 MB 00:04 2024-03-23T23:41:00.409 INFO:teuthology.orchestra.run.smithi059.stdout:linux-firmware-20240219-143.el9.noarch.rpm 39 MB/s | 375 MB 00:09 2024-03-23T23:41:00.410 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-23T23:41:00.410 INFO:teuthology.orchestra.run.smithi059.stdout:Total 39 MB/s | 375 MB 00:09 2024-03-23T23:41:00.411 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-23T23:41:00.515 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-23T23:41:00.515 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-23T23:41:02.454 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-23T23:41:03.011 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-23T23:41:03.011 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-23T23:41:04.909 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:================================================================================ 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 1 Package 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 375 M 2024-03-23T23:41:04.919 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-03-23T23:41:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-23T23:41:09.727 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-23T23:41:09.819 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T23:41:11.105 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T23:41:11.105 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-23T23:41:11.501 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T23:41:11.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:41:11.502 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-03-23T23:41:11.502 INFO:teuthology.orchestra.run.smithi059.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-23T23:41:11.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:41:11.502 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-23T23:41:11.789 INFO:teuthology.task.kernel:Downloading kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on mon.b... 2024-03-23T23:41:11.790 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:41:12.109 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ 2024-03-23T23:41:12.109 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-23T23:41:12.116 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi059.front.sepia.ceph.com to complete... 2024-03-23T23:41:16.229 INFO:teuthology.orchestra.run.smithi031.stdout:linux-firmware-20240219-143.el9.noarch.rpm 33 MB/s | 375 MB 00:11 2024-03-23T23:41:16.230 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-03-23T23:41:16.230 INFO:teuthology.orchestra.run.smithi031.stdout:Total 33 MB/s | 375 MB 00:11 2024-03-23T23:41:16.231 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-03-23T23:41:16.319 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-03-23T23:41:16.319 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-03-23T23:41:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-03-23T23:41:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-03-23T23:41:25.481 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-03-23T23:41:25.701 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-23T23:41:25.798 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T23:41:27.043 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T23:41:27.043 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-23T23:41:27.456 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T23:41:27.456 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:41:27.456 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-03-23T23:41:27.456 INFO:teuthology.orchestra.run.smithi031.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-23T23:41:27.456 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:41:27.456 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-03-23T23:41:27.747 INFO:teuthology.task.kernel:Downloading kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on mon.a... 2024-03-23T23:41:27.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T23:41:27.890 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ 2024-03-23T23:41:27.891 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-23T23:41:27.894 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi031.front.sepia.ceph.com to complete... 2024-03-23T23:43:00.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23 23:43:00 URL:https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm [336309687/336309687] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-23T23:43:00.594 INFO:teuthology.orchestra.run.smithi031.stderr:FINISHED --2024-03-23 23:43:00-- 2024-03-23T23:43:00.594 INFO:teuthology.orchestra.run.smithi031.stderr:Total wall clock time: 1m 33s 2024-03-23T23:43:00.594 INFO:teuthology.orchestra.run.smithi031.stderr:Downloaded: 1 files, 321M in 1m 32s (3.48 MB/s) 2024-03-23T23:43:00.598 INFO:teuthology.task.kernel:Installing kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on mon.a... 2024-03-23T23:43:00.598 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-23T23:43:02.633 INFO:teuthology.orchestra.run.smithi031.stdout:Verifying... ######################################## 2024-03-23T23:43:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23 23:43:02 URL:https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm [336309687/336309687] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-23T23:43:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:FINISHED --2024-03-23 23:43:02-- 2024-03-23T23:43:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:Total wall clock time: 1m 51s 2024-03-23T23:43:02.673 INFO:teuthology.orchestra.run.smithi059.stderr:Downloaded: 1 files, 321M in 1m 50s (2.92 MB/s) 2024-03-23T23:43:02.678 INFO:teuthology.task.kernel:Installing kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on mon.b... 2024-03-23T23:43:02.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-23T23:43:02.700 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing... ######################################## 2024-03-23T23:43:02.786 INFO:teuthology.orchestra.run.smithi031.stdout:Updating / installing... 2024-03-23T23:43:04.715 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying... ######################################## 2024-03-23T23:43:05.119 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing... ######################################## 2024-03-23T23:43:05.206 INFO:teuthology.orchestra.run.smithi059.stdout:Updating / installing... 2024-03-23T23:43:10.595 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-6.8.0_g5ec3e6e88b2e-1 ######################################## 2024-03-23T23:43:13.058 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-6.8.0_g5ec3e6e88b2e-1 ######################################## 2024-03-23T23:43:24.843 INFO:teuthology.orchestra.run.smithi031.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-23T23:43:27.331 INFO:teuthology.orchestra.run.smithi059.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-23T23:43:48.035 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi031.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-23T23:43:48.035 DEBUG:teuthology.orchestra.run.smithi031:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-23T23:43:48.108 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:48.108 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/System.map 2024-03-23T23:43:48.108 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/config 2024-03-23T23:43:48.108 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel 2024-03-23T23:43:48.108 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-23T23:43:48.109 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu 2024-03-23T23:43:48.110 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ansi_cprng.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/anubis.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/arc4.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_pq.ko 2024-03-23T23:43:48.111 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_tx.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_xor.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/raid6test.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authenc.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authencesn.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blake2b_generic.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_common.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_generic.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/camellia_generic.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast5_generic.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast6_generic.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast_common.ko 2024-03-23T23:43:48.112 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ccm.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cmac.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crc32_generic.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_engine.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_user.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cts.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/des_generic.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/dh_generic.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/echainiv.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/essiv.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/fcrypt.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/khazad.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4hc.ko 2024-03-23T23:43:48.113 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/md4.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/michael_mic.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcbc.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcrypt.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/rmd160.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/seed.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/serpent_generic.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tcrypt.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tea.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_common.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_generic.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/vmac.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/wp512.ko 2024-03-23T23:43:48.114 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xcbc.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xor.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xxhash_generic.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_pad.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/custom_method.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ec_sys.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/platform_profile.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbs.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbshc.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/video.ko 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata 2024-03-23T23:43:48.115 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/acard-ahci.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci_platform.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ata_generic.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci_platform.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_acpi.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ali.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_amd.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_artop.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atiixp.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atp867x.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd640.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cypress.ko 2024-03-23T23:43:48.116 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_efar.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt366.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it8213.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it821x.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_jmicron.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_marvell.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_mpiix.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_netcell.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ninja32.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87410.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87415.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-23T23:43:48.117 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_opti.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_optidma.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_piccolo.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rdc.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sch.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_serverworks.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sil680.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sis.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_triflex.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_via.ko 2024-03-23T23:43:48.118 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pdc_adma.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_inic162x.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_mv.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_nv.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_promise.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_qstor.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil24.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sis.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_svw.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sx4.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_uli.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_via.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_vsc.ko 2024-03-23T23:43:48.119 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/bcma.ko 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/aoe.ko 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/brd.ko 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/drbd.ko 2024-03-23T23:43:48.120 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/floppy.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/loop.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/nbd.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/pktcdvd.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/rbd.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/virtio_blk.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkfront.ko 2024-03-23T23:43:48.121 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/zram.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hangcheck-timer.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-23T23:43:48.122 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/lp.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/mwave.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ppdev.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tlclk.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-23T23:43:48.123 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/uv_mmtimer.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/virtio_console.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto 2024-03-23T23:43:48.124 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-aes.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-sha.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/dca.ko 2024-03-23T23:43:48.125 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/amd64_edac.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/e752x_edac.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3000_edac.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3200_edac.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5100_edac.ko 2024-03-23T23:43:48.126 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5400_edac.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7300_edac.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7core_edac.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i82975x_edac.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ie31200_edac.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/sb_edac.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/x38_edac.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/edd.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ich.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid 2024-03-23T23:43:48.127 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-appleir.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-aureal.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-axff.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-dr.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elecom.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elo.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-emsff.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gaff.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gt683r.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gyration.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtekff.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-hyperv.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-icade.ko 2024-03-23T23:43:48.128 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-keytouch.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kye.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lcpower.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-led.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lenovo.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-multitouch.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ortek.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-penmount.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-petalynx.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-picolcd.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-pl.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-plantronics.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-primax.ko 2024-03-23T23:43:48.129 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-rmi.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat.ko 2024-03-23T23:43:48.130 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-saitek.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-samsung.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sjoy.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sony.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-speedlink.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-steelseries.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sunplus.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tivo.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tmff.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-topseed.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-twinhan.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-uclogic.ko 2024-03-23T23:43:48.131 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-waltop.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-wiimote.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-xinmo.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zpff.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zydacron.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/uhid.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/wacom.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_balloon.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_utils.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_vmbus.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru3.ko 2024-03-23T23:43:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7414.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7418.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adc128d818.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1025.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1026.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1029.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1031.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm9240.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ads7828.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7410.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7411.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7462.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7470.ko 2024-03-23T23:43:48.133 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7475.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7x10.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/amc6821.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/applesmc.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asb100.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asc7621.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/atxp1.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/coretemp.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dme1737.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds1621.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds620.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc1403.ko 2024-03-23T23:43:48.134 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc6w201.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71805f.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71882fg.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f75375s.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fschmd.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g760a.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g762.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl518sm.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl520sm.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmaem.ko 2024-03-23T23:43:48.135 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmpex.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina209.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina2xx.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/it87.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k10temp.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k8temp.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm63.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm73.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm75.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm77.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm78.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm80.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm83.ko 2024-03-23T23:43:48.136 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm85.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm87.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm90.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm92.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm93.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95234.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95241.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95245.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc2945.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4151.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4215.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4222.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4245.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4260.ko 2024-03-23T23:43:48.137 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4261.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max16065.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1619.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1668.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max197.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6639.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6650.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6697.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mcp3021.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6683.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct7802.ko 2024-03-23T23:43:48.138 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87360.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87427.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pcf8591.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-23T23:43:48.139 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/powr1220.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5627.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5636.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht15.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht21.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/shtc1.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sis5595.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/thmc50.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp102.ko 2024-03-23T23:43:48.140 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp103.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp401.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp421.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via686a.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt1211.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt8231.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627hf.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83781d.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83791d.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83792d.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83793.ko 2024-03-23T23:43:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83795.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-23T23:43:48.142 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-23T23:43:48.143 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-dev.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-mux.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-stub.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-23T23:43:48.144 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5 2024-03-23T23:43:48.145 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-23T23:43:48.146 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/gameport.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/joydev.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/appletouch.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-23T23:43:48.147 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/sermouse.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serio_raw.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/sparse-keymap.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-blinkm.ko 2024-03-23T23:43:48.148 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3530.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp3944.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-ss4200.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-23T23:43:48.149 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/bcache.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bio-prison.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache-smq.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-crypt.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-delay.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-flakey.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log-userspace.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-multipath.ko 2024-03-23T23:43:48.150 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-queue-length.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-raid.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-round-robin.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-service-time.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-switch.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-thin-pool.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-verity.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid0.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid1.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid10.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid456.ko 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message 2024-03-23T23:43:48.151 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptbase.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptctl.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptfc.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptlan.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptsas.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptspi.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_ich.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_sch.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mfd-core.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/sm501.ko 2024-03-23T23:43:48.152 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/viperboard.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/vx855.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wl1273-core.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds9802als.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds990x.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/bh1770glc.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/cb710.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/at24.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-23T23:43:48.153 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/enclosure.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hpilo.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29003.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29020.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-me.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei.ko 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru 2024-03-23T23:43:48.154 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_core.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tsl2550.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_balloon.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/bonding.ko 2024-03-23T23:43:48.155 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dummy.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/eql.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-23T23:43:48.156 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-23T23:43:48.157 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-23T23:43:48.158 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-23T23:43:48.159 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec 2024-03-23T23:43:48.160 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dnet.ko 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet 2024-03-23T23:43:48.161 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-23T23:43:48.162 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/jme.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-23T23:43:48.163 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi 2024-03-23T23:43:48.164 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-23T23:43:48.165 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan 2024-03-23T23:43:48.166 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun 2024-03-23T23:43:48.167 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom 2024-03-23T23:43:48.168 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/geneve.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ifb.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvlan.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvtap.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio.ko 2024-03-23T23:43:48.169 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mii.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/net_failover.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/netconsole.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/nlmon.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/amd.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-23T23:43:48.170 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/broadcom.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/cicada.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/davicom.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/dp83640.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/et1011c.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/icplus.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/lxt.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/marvell.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/micrel.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/national.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/phylink.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/qsemi.ko 2024-03-23T23:43:48.171 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/realtek.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/smsc.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/vitesse.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppoe.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppox.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pptp.ko 2024-03-23T23:43:48.172 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slhc.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slip.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sungem_phy.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tap.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_random.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tun.ko 2024-03-23T23:43:48.173 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/veth.ko 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/virtio_net.ko 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netfront.ko 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ntb.ko 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme 2024-03-23T23:43:48.174 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_cs.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_pc.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_serial.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/xen-pcifront.ko 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia 2024-03-23T23:43:48.175 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/i82092.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pd6729.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-23T23:43:48.176 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/hdaps.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-23T23:43:48.177 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/pps_core.ko 2024-03-23T23:43:48.178 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-23T23:43:48.179 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-23T23:43:48.180 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-sas.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/BusLogic.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/a100u2w.ko 2024-03-23T23:43:48.181 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/advansys.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/am53c974.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/atp870u.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-23T23:43:48.182 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ch.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dc395x.ko 2024-03-23T23:43:48.183 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dmx3191d.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esp_scsi.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic 2024-03-23T23:43:48.184 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hpsa.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hptiop.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/initio.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ipr.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ips.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/isci.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-23T23:43:48.185 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-23T23:43:48.186 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvumi.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pmcraid.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla1280.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/raid_class.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_debug.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-23T23:43:48.187 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ses.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/st.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/stex.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/wd719x.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ssb.ko 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target 2024-03-23T23:43:48.188 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_file.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_iblock.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_mod.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_pscsi.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_user.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel 2024-03-23T23:43:48.189 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-23T23:43:48.190 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_gsm.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_hdlc.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/nozomi.ko 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250 2024-03-23T23:43:48.191 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_aec.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_cif.ko 2024-03-23T23:43:48.192 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_sercos3.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usblp.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usbtmc.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/mdc800.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/microtek.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/adutux.ko 2024-03-23T23:43:48.193 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi26.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi62.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ezusb.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/idmouse.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ldusb.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usb3503.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usblcd.ko 2024-03-23T23:43:48.194 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/uss720.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/yurex.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/aircable.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ark3116.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ch341.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cp210x.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-23T23:43:48.195 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/empeg.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_ti.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipaq.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipw.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-23T23:43:48.196 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7720.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7840.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/navman.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/omninet.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/opticon.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/option.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/oti6858.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/pl2303.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcaux.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcserial.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/quatech2.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/sierra.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-23T23:43:48.197 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ssu100.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/visor.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/uas.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-23T23:43:48.198 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio 2024-03-23T23:43:48.199 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_net.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-23T23:43:48.200 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lcd.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_ring.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2482.ko 2024-03-23T23:43:48.201 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2490.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-23T23:43:48.202 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/wire.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/hpwdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/i6300esb.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ibmasr.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/machzwd.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/nv_tco.ko 2024-03-23T23:43:48.203 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/softdog.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/via_wdt.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-evtchn.ko 2024-03-23T23:43:48.204 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntdev.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-privcmd.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/9p.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/affs.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/befs.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/binfmt_misc.ko 2024-03-23T23:43:48.205 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/btrfs.ko 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/cachefiles.ko 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ceph.ko 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/coda.ko 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/cramfs.ko 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/dlm.ko 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-23T23:43:48.206 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/f2fs.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/fat.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/msdos.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/vfat.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/cuse.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/fuse.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/gfs2.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/hfs.ko 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus 2024-03-23T23:43:48.207 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/hfsplus.ko 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/isofs.ko 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/jfs.ko 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/lockd.ko 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/minix.ko 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/netfs.ko 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-23T23:43:48.208 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfs.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv3.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv4.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/grace.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/nfsd.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/nilfs2.ko 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls 2024-03-23T23:43:48.209 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-celtic.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-centeuro.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-croatian.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-cyrillic.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-gaelic.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-greek.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-iceland.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-inuit.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-roman.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-romanian.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-turkish.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1250.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1251.ko 2024-03-23T23:43:48.210 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1255.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp737.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp775.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp850.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp852.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp855.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp857.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp860.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp861.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp862.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp863.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp864.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp865.ko 2024-03-23T23:43:48.211 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp866.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp869.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp874.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp932.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp936.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp949.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp950.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_euc-jp.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-23T23:43:48.212 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-r.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-u.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_utf8.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-23T23:43:48.213 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/overlay.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ramoops.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/reiserfs.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/romfs.ko 2024-03-23T23:43:48.214 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/cifs.ko 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_md4.ko 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/squashfs.ko 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/sysv.ko 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/udf.ko 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ufs.ko 2024-03-23T23:43:48.215 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/xfs.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu/rcutorture.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/torture.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/asn1_encoder.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc-itu-t.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc8.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libarc4.ko 2024-03-23T23:43:48.216 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libdes.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/libcrc32c.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lru_cache.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4_compress.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/cordic.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/raid6_pq.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_bm.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_fsm.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_kmp.ko 2024-03-23T23:43:48.217 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd/zstd_compress.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/hwpoison-inject.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/6lowpan.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_dest.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_hop.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_routing.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_udp.ko 2024-03-23T23:43:48.218 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/garp.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/mrp.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/p8022.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/psnap.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/stp.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/8021q.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_fd.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_rdma.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_virtio.ko 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv 2024-03-23T23:43:48.219 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/batman-adv.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/br_netfilter.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/bridge.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-23T23:43:48.220 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-23T23:43:48.221 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/libceph.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/failover.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/pktgen.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_diag.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv4.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv6.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa 2024-03-23T23:43:48.222 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/dsa_core.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_brcm.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_dsa.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_none.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_trailer.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ah4.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/esp4.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/fou.ko 2024-03-23T23:43:48.223 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/gre.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/inet_diag.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_gre.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_tunnel.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_vti.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipcomp.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipip.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-23T23:43:48.224 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-23T23:43:48.225 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_bic.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_diag.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_htcp.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_hybla.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_illinois.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_lp.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_scalable.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_vegas.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_veno.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_westwood.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_yeah.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tunnel4.ko 2024-03-23T23:43:48.226 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_diag.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_tunnel.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ah6.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/esp6.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/fou6.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_vti.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ipcomp6.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-23T23:43:48.227 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-23T23:43:48.228 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/sit.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/tunnel6.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/af_key.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_core.ko 2024-03-23T23:43:48.229 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_eth.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/mac802154.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/mpls_gso.ko 2024-03-23T23:43:48.230 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-23T23:43:48.231 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-23T23:43:48.232 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conncount.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-23T23:43:48.233 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-23T23:43:48.234 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_tables.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_compat.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_ct.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fib.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-23T23:43:48.235 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_hash.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_limit.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_log.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_masq.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_nat.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_numgen.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_queue.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_quota.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_redir.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_socket.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_tunnel.ko 2024-03-23T23:43:48.236 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CT.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_DSCP.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HL.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HMARK.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LED.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LOG.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-23T23:43:48.237 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TEE.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TRACE.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_addrtype.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_bpf.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cgroup.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cluster.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_comment.ko 2024-03-23T23:43:48.238 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connbytes.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlabel.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlimit.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connmark.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_conntrack.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cpu.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dccp.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_devgroup.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dscp.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ecn.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_esp.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_helper.ko 2024-03-23T23:43:48.239 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hl.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_iprange.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipvs.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_l2tp.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_length.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_limit.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mac.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mark.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_multiport.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nat.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nfacct.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_osf.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_owner.ko 2024-03-23T23:43:48.240 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_physdev.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_pkttype.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_policy.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_quota.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_rateest.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_realm.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_recent.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_sctp.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_set.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_socket.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_state.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_statistic.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_string.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-23T23:43:48.241 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_time.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_u32.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/netlink_diag.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/nsh.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/openvswitch.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-geneve.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-gre.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/af_packet_diag.ko 2024-03-23T23:43:48.242 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_rdma.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_tcp.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_csum.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_gact.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_mirred.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_nat.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_pedit.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_police.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_simple.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_skbedit.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_vlan.ko 2024-03-23T23:43:48.243 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_basic.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_bpf.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_flow.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_fw.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_route.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_u32.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_cmp.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_ipset.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_meta.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_nbyte.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_text.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_u32.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_choke.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_codel.ko 2024-03-23T23:43:48.244 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_drr.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_gred.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hfsc.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hhf.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_htb.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_ingress.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_multiq.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_netem.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_pie.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_plug.ko 2024-03-23T23:43:48.245 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_prio.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_qfq.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_red.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfb.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfq.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_tbf.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_teql.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp_diag.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-23T23:43:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/sunrpc.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/diag.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/tipc.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/unix_diag.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-23T23:43:48.247 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/irqbypass.ko 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias.bin 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin 2024-03-23T23:43:48.248 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.alias.bin 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.bin 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.modinfo 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep.bin 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.devname 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.order 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.softdep 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols.bin 2024-03-23T23:43:48.249 INFO:teuthology.orchestra.run.smithi031.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-23T23:43:48.253 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:48.253 DEBUG:teuthology.orchestra.run.smithi031:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-23T23:43:48.276 INFO:teuthology.orchestra.run.smithi031.stdout:postinstall scriptlet (using /bin/sh): 2024-03-23T23:43:48.276 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-23T23:43:48.276 INFO:teuthology.orchestra.run.smithi031.stdout: /usr/bin/kernel-install add 6.8.0-g5ec3e6e88b2e /lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-23T23:43:48.276 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2024-03-23T23:43:48.276 INFO:teuthology.orchestra.run.smithi031.stdout:for file in vmlinuz System.map config; do 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout: if ! cmp --silent "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e"; then 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout: cp "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e" 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout: fi 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:done 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:new-kernel-pkg --remove 6.8.0-g5ec3e6e88b2e --rminitrd --initrdfile=/boot/initramfs-6.8.0-g5ec3e6e88b2e.img 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-install remove 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-23T23:43:48.277 INFO:teuthology.orchestra.run.smithi031.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-23T23:43:48.278 INFO:teuthology.orchestra.run.smithi031.stdout:/sbin/update-bootloader --remove 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:48.278 INFO:teuthology.orchestra.run.smithi031.stdout:fi 2024-03-23T23:43:48.279 DEBUG:teuthology.orchestra.run.smithi031:> sudo rpm -qi grub2-tools 2024-03-23T23:43:48.358 INFO:teuthology.orchestra.run.smithi031.stdout:Name : grub2-tools 2024-03-23T23:43:48.358 INFO:teuthology.orchestra.run.smithi031.stdout:Epoch : 1 2024-03-23T23:43:48.358 INFO:teuthology.orchestra.run.smithi031.stdout:Version : 2.06 2024-03-23T23:43:48.358 INFO:teuthology.orchestra.run.smithi031.stdout:Release : 68.el9 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Architecture: x86_64 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Group : Unspecified 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Size : 8264254 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:License : GPLv3+ 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-23T23:43:48.359 INFO:teuthology.orchestra.run.smithi031.stdout:Packager : builder@centos.org 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:Vendor : CentOS 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:Summary : Support tools for GRUB. 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:Description : 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-23T23:43:48.360 INFO:teuthology.orchestra.run.smithi031.stdout:hardware devices. 2024-03-23T23:43:48.361 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:43:48.361 INFO:teuthology.orchestra.run.smithi031.stdout:This subpackage provides tools for support of all platforms. 2024-03-23T23:43:48.362 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-23T23:43:48.362 INFO:teuthology.task.kernel:Updating grub on smithi031 to boot 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:48.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-23T23:43:49.082 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-03-23T23:43:50.517 INFO:teuthology.orchestra.run.smithi031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-23T23:43:50.547 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-23T23:43:50.547 DEBUG:teuthology.orchestra.run.smithi059:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-23T23:43:50.553 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-03-23T23:43:50.556 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-03-23T23:43:50.617 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.ZTeZTuGYYA 2024-03-23T23:43:50.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ZTeZTuGYYA 2024-03-23T23:43:50.624 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/System.map 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/config 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-23T23:43:50.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-23T23:43:50.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ansi_cprng.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/anubis.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/arc4.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-23T23:43:50.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_pq.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_tx.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_xor.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/raid6test.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authenc.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authencesn.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blake2b_generic.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_common.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_generic.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/camellia_generic.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast5_generic.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast6_generic.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast_common.ko 2024-03-23T23:43:50.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ccm.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cmac.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crc32_generic.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_engine.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_user.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cts.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/des_generic.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/dh_generic.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/echainiv.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/essiv.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/fcrypt.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/khazad.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4hc.ko 2024-03-23T23:43:50.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/md4.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/michael_mic.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcbc.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcrypt.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/rmd160.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/seed.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/serpent_generic.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tcrypt.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tea.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_common.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_generic.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/vmac.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/wp512.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xcbc.ko 2024-03-23T23:43:50.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xor.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xxhash_generic.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_pad.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/custom_method.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ec_sys.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/platform_profile.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbs.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbshc.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/video.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/acard-ahci.ko 2024-03-23T23:43:50.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci_platform.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ata_generic.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci_platform.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_acpi.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ali.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_amd.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_artop.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atiixp.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atp867x.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd640.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cypress.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_efar.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt366.ko 2024-03-23T23:43:50.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it8213.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it821x.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_jmicron.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_marvell.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_mpiix.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_netcell.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ninja32.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87410.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87415.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_opti.ko 2024-03-23T23:43:50.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_optidma.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_piccolo.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rdc.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sch.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_serverworks.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sil680.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sis.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_triflex.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_via.ko 2024-03-23T23:43:50.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pdc_adma.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_inic162x.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_mv.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_nv.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_promise.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_qstor.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil24.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sis.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_svw.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sx4.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_uli.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_via.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_vsc.ko 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay 2024-03-23T23:43:50.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/bcma.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/aoe.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/brd.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/drbd.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/floppy.ko 2024-03-23T23:43:50.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/loop.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/nbd.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/pktcdvd.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/rbd.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/virtio_blk.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkfront.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/zram.ko 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char 2024-03-23T23:43:50.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hangcheck-timer.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-23T23:43:50.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/lp.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/mwave.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ppdev.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tlclk.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/uv_mmtimer.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/virtio_console.ko 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq 2024-03-23T23:43:50.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-23T23:43:50.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-aes.ko 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-sha.ko 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/dca.ko 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat 2024-03-23T23:43:50.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/amd64_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/e752x_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3000_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3200_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5100_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5400_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7300_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7core_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i82975x_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ie31200_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/sb_edac.ko 2024-03-23T23:43:50.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/x38_edac.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/edd.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ich.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-appleir.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-aureal.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-axff.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-dr.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elecom.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elo.ko 2024-03-23T23:43:50.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-emsff.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gaff.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gt683r.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gyration.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtekff.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-hyperv.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-icade.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-keytouch.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kye.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lcpower.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-led.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lenovo.ko 2024-03-23T23:43:50.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-multitouch.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ortek.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-penmount.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-petalynx.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-picolcd.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-pl.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-plantronics.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-primax.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-rmi.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-23T23:43:50.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-saitek.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-samsung.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sjoy.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sony.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-speedlink.ko 2024-03-23T23:43:50.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-steelseries.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sunplus.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tivo.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tmff.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-topseed.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-twinhan.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-uclogic.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-waltop.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-wiimote.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-xinmo.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zpff.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zydacron.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/uhid.ko 2024-03-23T23:43:50.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/wacom.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_balloon.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_utils.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_vmbus.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru3.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7414.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7418.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adc128d818.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1025.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1026.ko 2024-03-23T23:43:50.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1029.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1031.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm9240.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ads7828.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7410.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7411.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7462.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7470.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7475.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7x10.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/amc6821.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/applesmc.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asb100.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asc7621.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-23T23:43:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/atxp1.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/coretemp.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dme1737.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds1621.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds620.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc1403.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc6w201.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71805f.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71882fg.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f75375s.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-23T23:43:50.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fschmd.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g760a.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g762.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl518sm.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl520sm.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmaem.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmpex.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina209.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina2xx.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/it87.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k10temp.ko 2024-03-23T23:43:50.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k8temp.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm63.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm73.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm75.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm77.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm78.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm80.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm83.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm85.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm87.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm90.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm92.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm93.ko 2024-03-23T23:43:50.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95234.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95241.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95245.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc2945.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4151.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4215.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4222.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4245.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4260.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4261.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max16065.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1619.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1668.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max197.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6639.ko 2024-03-23T23:43:50.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6650.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6697.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mcp3021.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6683.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct7802.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87360.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87427.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pcf8591.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-23T23:43:50.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/powr1220.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5627.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5636.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht15.ko 2024-03-23T23:43:50.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht21.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/shtc1.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sis5595.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/thmc50.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp102.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp103.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp401.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp421.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via686a.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt1211.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt8231.ko 2024-03-23T23:43:50.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627hf.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83781d.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83791d.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83792d.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83793.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83795.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses 2024-03-23T23:43:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-23T23:43:50.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-dev.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-mux.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-stub.ko 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband 2024-03-23T23:43:50.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5 2024-03-23T23:43:50.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-23T23:43:50.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/gameport.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/joydev.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/appletouch.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/sermouse.ko 2024-03-23T23:43:50.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serio_raw.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/sparse-keymap.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-blinkm.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3530.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp3944.ko 2024-03-23T23:43:50.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-ss4200.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/bcache.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bio-prison.ko 2024-03-23T23:43:50.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache-smq.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-crypt.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-delay.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-flakey.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log-userspace.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-multipath.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-queue-length.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-raid.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-round-robin.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-service-time.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-switch.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-thin-pool.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-verity.ko 2024-03-23T23:43:50.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid0.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid1.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid10.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid456.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptbase.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptctl.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptfc.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptlan.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptsas.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-23T23:43:50.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptspi.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_ich.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_sch.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mfd-core.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/sm501.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/viperboard.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/vx855.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wl1273-core.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds9802als.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds990x.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/bh1770glc.ko 2024-03-23T23:43:50.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/cb710.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/at24.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/enclosure.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hpilo.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29003.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29020.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei 2024-03-23T23:43:50.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-me.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_core.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tsl2550.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_balloon.ko 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci 2024-03-23T23:43:50.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/bonding.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dummy.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/eql.ko 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet 2024-03-23T23:43:50.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon 2024-03-23T23:43:50.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-23T23:43:50.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-23T23:43:50.673 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-23T23:43:50.674 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dnet.ko 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet 2024-03-23T23:43:50.675 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf 2024-03-23T23:43:50.676 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/jme.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox 2024-03-23T23:43:50.677 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-23T23:43:50.678 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc 2024-03-23T23:43:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-23T23:43:50.680 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-23T23:43:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/geneve.ko 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv 2024-03-23T23:43:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ifb.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvlan.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvtap.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mii.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/net_failover.ko 2024-03-23T23:43:50.683 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/netconsole.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/nlmon.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/amd.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/broadcom.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/cicada.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/davicom.ko 2024-03-23T23:43:50.684 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/dp83640.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/et1011c.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/icplus.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/lxt.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/marvell.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/micrel.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/national.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/phylink.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/qsemi.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/realtek.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/smsc.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/vitesse.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-23T23:43:50.685 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppoe.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppox.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pptp.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slhc.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slip.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sungem_phy.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tap.ko 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team 2024-03-23T23:43:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_random.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tun.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/veth.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/virtio_net.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback 2024-03-23T23:43:50.687 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netfront.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ntb.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_cs.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_pc.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_serial.ko 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci 2024-03-23T23:43:50.688 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/xen-pcifront.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/i82092.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pd6729.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-23T23:43:50.689 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/hdaps.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-23T23:43:50.690 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients 2024-03-23T23:43:50.691 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/pps_core.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-23T23:43:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-23T23:43:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-sas.ko 2024-03-23T23:43:50.694 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-23T23:43:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/BusLogic.ko 2024-03-23T23:43:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/a100u2w.ko 2024-03-23T23:43:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid 2024-03-23T23:43:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-23T23:43:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/advansys.ko 2024-03-23T23:43:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx 2024-03-23T23:43:50.695 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-23T23:43:50.697 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/am53c974.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/atp870u.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ch.ko 2024-03-23T23:43:50.698 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dc395x.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-23T23:43:50.699 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dmx3191d.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esp_scsi.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hpsa.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hptiop.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/initio.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ipr.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ips.ko 2024-03-23T23:43:50.700 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/isci.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid.ko 2024-03-23T23:43:50.701 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvumi.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pmcraid.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla1280.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-23T23:43:50.702 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/raid_class.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_debug.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ses.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/st.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/stex.ko 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2 2024-03-23T23:43:50.703 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/wd719x.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ssb.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_file.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_iblock.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_mod.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_pscsi.ko 2024-03-23T23:43:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_user.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-23T23:43:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-23T23:43:50.706 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_gsm.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_hdlc.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/nozomi.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio 2024-03-23T23:43:50.707 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_aec.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_cif.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_sercos3.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usblp.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usbtmc.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/mdc800.ko 2024-03-23T23:43:50.708 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/microtek.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/adutux.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi26.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi62.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ezusb.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/idmouse.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ldusb.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-23T23:43:50.709 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usb3503.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usblcd.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/uss720.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/yurex.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/aircable.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ark3116.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ch341.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cp210x.ko 2024-03-23T23:43:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/empeg.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_ti.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipaq.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipw.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-23T23:43:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7720.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7840.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/navman.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/omninet.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/opticon.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/option.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/oti6858.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/pl2303.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcaux.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcserial.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/quatech2.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-23T23:43:50.712 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/sierra.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ssu100.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/visor.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/uas.ko 2024-03-23T23:43:50.713 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-23T23:43:50.714 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_net.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-23T23:43:50.715 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lcd.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_ring.ko 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1 2024-03-23T23:43:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2482.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2490.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-23T23:43:50.717 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/wire.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/hpwdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/i6300esb.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ibmasr.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-23T23:43:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/machzwd.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/nv_tco.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/softdog.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/via_wdt.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-23T23:43:50.719 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-evtchn.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntdev.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-privcmd.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/9p.ko 2024-03-23T23:43:50.720 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/affs.ko 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/befs.ko 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/binfmt_misc.ko 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/btrfs.ko 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/cachefiles.ko 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ceph.ko 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/coda.ko 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs 2024-03-23T23:43:50.721 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/cramfs.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/dlm.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/f2fs.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/fat.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/msdos.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/vfat.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/cuse.ko 2024-03-23T23:43:50.722 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/fuse.ko 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/gfs2.ko 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/hfs.ko 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/hfsplus.ko 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/isofs.ko 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/jfs.ko 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/lockd.ko 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix 2024-03-23T23:43:50.723 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/minix.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/netfs.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfs.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv3.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv4.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/grace.ko 2024-03-23T23:43:50.724 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/nfsd.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/nilfs2.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-celtic.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-centeuro.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-croatian.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-cyrillic.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-gaelic.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-greek.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-iceland.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-inuit.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-roman.ko 2024-03-23T23:43:50.725 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-romanian.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-turkish.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1250.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1251.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1255.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp737.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp775.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp850.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp852.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp855.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp857.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp860.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp861.ko 2024-03-23T23:43:50.726 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp862.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp863.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp864.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp865.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp866.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp869.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp874.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp932.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp936.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp949.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp950.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_euc-jp.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-23T23:43:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-r.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-u.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_utf8.ko 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2 2024-03-23T23:43:50.728 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/overlay.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ramoops.ko 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs 2024-03-23T23:43:50.729 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/reiserfs.ko 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/romfs.ko 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/cifs.ko 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_md4.ko 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/squashfs.ko 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/sysv.ko 2024-03-23T23:43:50.730 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/udf.ko 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ufs.ko 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/xfs.ko 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu/rcutorture.ko 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/torture.ko 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/asn1_encoder.ko 2024-03-23T23:43:50.731 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc-itu-t.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc8.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libarc4.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libdes.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/libcrc32c.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lru_cache.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4_compress.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/cordic.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/raid6_pq.ko 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon 2024-03-23T23:43:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_bm.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_fsm.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_kmp.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd/zstd_compress.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/hwpoison-inject.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/6lowpan.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_dest.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_hop.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-23T23:43:50.733 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_routing.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_udp.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/garp.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/mrp.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/p8022.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/psnap.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/stp.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/8021q.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_fd.ko 2024-03-23T23:43:50.734 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_rdma.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_virtio.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/batman-adv.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/br_netfilter.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/bridge.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-23T23:43:50.735 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-23T23:43:50.736 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/libceph.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/failover.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/pktgen.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_diag.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv4.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv6.ko 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver 2024-03-23T23:43:50.737 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/dsa_core.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_brcm.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_dsa.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_none.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_trailer.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ah4.ko 2024-03-23T23:43:50.738 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/esp4.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/fou.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/gre.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/inet_diag.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_gre.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_tunnel.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_vti.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipcomp.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipip.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-23T23:43:50.739 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-23T23:43:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_bic.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_diag.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_htcp.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_hybla.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_illinois.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_lp.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_scalable.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_vegas.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_veno.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_westwood.ko 2024-03-23T23:43:50.741 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_yeah.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tunnel4.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_diag.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_tunnel.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ah6.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/esp6.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/fou6.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_vti.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ipcomp6.ko 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter 2024-03-23T23:43:50.742 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-23T23:43:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/sit.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/tunnel6.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/af_key.ko 2024-03-23T23:43:50.744 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_core.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_eth.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/mac802154.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/mpls_gso.ko 2024-03-23T23:43:50.745 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-23T23:43:50.746 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-23T23:43:50.747 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conncount.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-23T23:43:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-23T23:43:50.749 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_tables.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_compat.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_ct.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fib.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_hash.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_limit.ko 2024-03-23T23:43:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_log.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_masq.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_nat.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_numgen.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_queue.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_quota.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_redir.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_socket.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_tunnel.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-23T23:43:50.751 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CT.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_DSCP.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HL.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HMARK.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LED.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LOG.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-23T23:43:50.752 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TEE.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TRACE.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_addrtype.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_bpf.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cgroup.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cluster.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_comment.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connbytes.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlabel.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlimit.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connmark.ko 2024-03-23T23:43:50.753 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_conntrack.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cpu.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dccp.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_devgroup.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dscp.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ecn.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_esp.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_helper.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hl.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_iprange.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipvs.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_l2tp.ko 2024-03-23T23:43:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_length.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_limit.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mac.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mark.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_multiport.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nat.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nfacct.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_osf.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_owner.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_physdev.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_pkttype.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_policy.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_quota.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_rateest.ko 2024-03-23T23:43:50.755 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_realm.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_recent.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_sctp.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_set.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_socket.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_state.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_statistic.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_string.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_time.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_u32.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/netlink_diag.ko 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh 2024-03-23T23:43:50.756 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/nsh.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/openvswitch.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-geneve.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-gre.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/af_packet_diag.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_rdma.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_tcp.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_csum.ko 2024-03-23T23:43:50.757 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_gact.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_mirred.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_nat.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_pedit.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_police.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_simple.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_skbedit.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_vlan.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_basic.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_bpf.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_flow.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_fw.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_route.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_u32.ko 2024-03-23T23:43:50.758 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_cmp.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_ipset.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_meta.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_nbyte.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_text.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_u32.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_choke.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_codel.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_drr.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_gred.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hfsc.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hhf.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_htb.ko 2024-03-23T23:43:50.759 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_ingress.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_multiq.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_netem.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_pie.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_plug.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_prio.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_qfq.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_red.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfb.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfq.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_tbf.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_teql.ko 2024-03-23T23:43:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp_diag.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/sunrpc.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/diag.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/tipc.ko 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix 2024-03-23T23:43:50.761 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/unix_diag.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys 2024-03-23T23:43:50.762 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/irqbypass.ko 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias.bin 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.alias.bin 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.bin 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.modinfo 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep.bin 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.devname 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.order 2024-03-23T23:43:50.763 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.softdep 2024-03-23T23:43:50.764 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols 2024-03-23T23:43:50.764 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols.bin 2024-03-23T23:43:50.764 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-23T23:43:50.767 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:50.767 DEBUG:teuthology.orchestra.run.smithi059:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-23T23:43:50.790 INFO:teuthology.orchestra.run.smithi059.stdout:postinstall scriptlet (using /bin/sh): 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout: /usr/bin/kernel-install add 6.8.0-g5ec3e6e88b2e /lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout:for file in vmlinuz System.map config; do 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout: if ! cmp --silent "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e"; then 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout: cp "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e" 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout: fi 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout:done 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-23T23:43:50.791 INFO:teuthology.orchestra.run.smithi059.stdout:new-kernel-pkg --remove 6.8.0-g5ec3e6e88b2e --rminitrd --initrdfile=/boot/initramfs-6.8.0-g5ec3e6e88b2e.img 2024-03-23T23:43:50.792 INFO:teuthology.orchestra.run.smithi059.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-23T23:43:50.792 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-install remove 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:50.792 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2024-03-23T23:43:50.792 INFO:teuthology.orchestra.run.smithi059.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-23T23:43:50.792 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-23T23:43:50.792 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/update-bootloader --remove 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:50.792 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2024-03-23T23:43:50.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2024-03-23T23:43:50.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.ZTeZTuGYYA 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.06 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 68.el9 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Group : Unspecified 2024-03-23T23:43:50.873 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 8264254 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : builder@centos.org 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-23T23:43:50.874 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-23T23:43:50.875 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2024-03-23T23:43:50.875 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:43:50.875 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2024-03-23T23:43:50.875 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-23T23:43:50.876 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:50.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-23T23:43:50.957 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.ZTeZTuGYYA is 6KB 2024-03-23T23:43:51.004 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.ZTeZTuGYYA 2024-03-23T23:43:51.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo /bin/ls /boot/loader/entries || true 2024-03-23T23:43:51.087 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-23T23:43:51.087 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-23T23:43:51.087 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-23T23:43:51.087 INFO:teuthology.orchestra.run.smithi031.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e.conf 2024-03-23T23:43:51.088 DEBUG:teuthology.orchestra.run.smithi031:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:51.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo shutdown -r now 2024-03-23T23:43:51.451 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-03-23T23:43:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-23T23:43:53.180 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-03-23T23:43:53.183 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-03-23T23:43:53.197 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.l2809ehAEQ 2024-03-23T23:43:53.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.l2809ehAEQ 2024-03-23T23:43:53.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.l2809ehAEQ 2024-03-23T23:43:53.415 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.l2809ehAEQ is 6KB 2024-03-23T23:43:53.437 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.l2809ehAEQ 2024-03-23T23:43:53.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2024-03-23T23:43:53.520 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-23T23:43:53.520 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-23T23:43:53.520 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-23T23:43:53.520 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e.conf 2024-03-23T23:43:53.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e 2024-03-23T23:43:53.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2024-03-23T23:44:21.250 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-23T23:44:21.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-03-23T23:44:21.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:44:23.680 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-23T23:44:23.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-23T23:44:23.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:44:39.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-03-23T23:44:42.014 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-03-23T23:44:48.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-03-23T23:44:48.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:44:51.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-23T23:44:51.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:45:07.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-03-23T23:45:19.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-03-23T23:45:19.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:45:22.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-03-23T23:45:37.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-03-23T23:45:37.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:45:37.610 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-03-23T23:45:38.158 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-03-23T23:45:38.158 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g5ec3e6e88b2e"... 2024-03-23T23:45:38.158 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-03-23T23:45:38.202 INFO:teuthology.orchestra.run.smithi031.stdout:6.8.0-g5ec3e6e88b2e 2024-03-23T23:45:38.203 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g5ec3e6e88b2e vs 6.8.0-g5ec3e6e88b2e 2024-03-23T23:45:38.203 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-23T23:45:38.203 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-23T23:45:39.203 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-23T23:45:39.204 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-23T23:45:39.588 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2024-03-23T23:45:39.650 DEBUG:teuthology.parallel:result is None 2024-03-23T23:45:51.021 DEBUG:teuthology.orchestra.remote:timed out 2024-03-23T23:46:03.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-23T23:46:03.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:46:03.502 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-03-23T23:46:04.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-23T23:46:04.170 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g5ec3e6e88b2e"... 2024-03-23T23:46:04.170 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-03-23T23:46:04.224 INFO:teuthology.orchestra.run.smithi059.stdout:6.8.0-g5ec3e6e88b2e 2024-03-23T23:46:04.224 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g5ec3e6e88b2e vs 6.8.0-g5ec3e6e88b2e 2024-03-23T23:46:04.225 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-23T23:46:04.225 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-23T23:46:05.225 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-23T23:46:05.225 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-23T23:46:05.391 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2024-03-23T23:46:05.458 DEBUG:teuthology.parallel:result is None 2024-03-23T23:46:05.459 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-23T23:46:05.466 INFO:teuthology.task.internal:Creating test directory... 2024-03-23T23:46:05.467 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-23T23:46:05.475 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-23T23:46:05.535 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-23T23:46:05.542 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-23T23:46:05.569 INFO:teuthology.task.internal:Creating archive directory... 2024-03-23T23:46:05.569 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-23T23:46:05.576 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-23T23:46:05.645 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-23T23:46:05.651 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-23T23:46:05.652 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-23T23:46:05.659 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-23T23:46:05.757 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:46:05.768 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:46:05.802 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:46:05.812 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T23:46:05.817 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-23T23:46:05.824 INFO:teuthology.task.internal:Configuring sudo... 2024-03-23T23:46:05.824 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-23T23:46:05.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-23T23:46:05.928 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-23T23:46:05.937 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-23T23:46:05.938 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-23T23:46:05.942 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-23T23:46:05.999 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T23:46:06.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T23:46:06.212 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T23:46:06.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T23:46:06.406 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:46:06.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-23T23:46:06.506 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T23:46:06.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T23:46:06.721 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T23:46:06.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T23:46:06.911 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:46:06.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-23T23:46:07.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-03-23T23:46:07.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-03-23T23:46:07.158 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T23:46:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T23:46:07.650 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-23T23:46:07.658 INFO:teuthology.task.internal:Starting timer... 2024-03-23T23:46:07.658 INFO:teuthology.run_tasks:Running task pcp... 2024-03-23T23:46:07.697 INFO:teuthology.run_tasks:Running task selinux... 2024-03-23T23:46:07.730 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-23T23:46:07.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2024-03-23T23:46:07.869 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2024-03-23T23:46:07.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-03-23T23:46:08.019 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-03-23T23:46:08.023 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-23T23:46:08.023 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2024-03-23T23:46:08.081 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2024-03-23T23:46:08.082 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-03-23T23:46:08.138 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-03-23T23:46:08.139 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi059.front.sepia.ceph.com': 'permissive'} 2024-03-23T23:46:08.139 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-23T23:46:08.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:46:08.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-23T23:46:08.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:46:08.393 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-23T23:46:08.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2024-03-23T23:46:08.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-03-23T23:46:08.586 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-23T23:46:08.721 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-23T23:46:08.741 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-23T23:46:08.743 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi059.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-23T23:52:33.525 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com')] 2024-03-23T23:52:33.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-03-23T23:52:33.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:52:33.677 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-03-23T23:52:33.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-03-23T23:52:33.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-23T23:52:33.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T23:52:33.986 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-03-23T23:52:34.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-03-23T23:52:34.145 INFO:teuthology.run_tasks:Running task clock... 2024-03-23T23:52:34.157 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-23T23:52:34.157 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-23T23:52:34.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T23:52:34.165 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-23T23:52:34.165 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T23:52:34.272 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-23T23:52:34.273 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-23T23:52:34.329 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-23T23:52:34.330 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-23T23:52:34.428 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2024-03-23T23:52:34.431 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-03-23T23:52:34.470 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2024-03-23T23:52:34.476 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-03-23T23:52:34.519 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-23T23:52:34.531 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-23T23:52:34.577 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-23T23:52:34.586 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-23T23:52:34.716 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-03-23T23:52:34.725 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-03-23T23:52:34.725 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T23:52:34.725 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-03-23T23:52:34.725 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.725 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.725 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.726 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.733 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T23:52:34.733 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-03-23T23:52:34.733 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.733 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.733 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.733 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:52:34.734 INFO:teuthology.run_tasks:Running task install... 2024-03-23T23:52:34.742 DEBUG:teuthology.task.install:project ceph 2024-03-23T23:52:34.742 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}} 2024-03-23T23:52:34.742 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'} 2024-03-23T23:52:34.743 INFO:teuthology.task.install:Using flavor: default 2024-03-23T23:52:34.749 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-23T23:52:34.749 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-23T23:52:34.749 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'tag': None, 'wait_for_package': False} 2024-03-23T23:52:34.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:52:34.752 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'tag': None, 'wait_for_package': False} 2024-03-23T23:52:34.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:52:34.975 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/ 2024-03-23T23:52:34.975 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2145.g3be9a5c9 2024-03-23T23:52:34.979 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/ 2024-03-23T23:52:34.979 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2145.g3be9a5c9 2024-03-23T23:52:35.219 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-23T23:52:35.219 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:52:35.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-23T23:52:35.224 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-main-20240318.032620/3be9a5c9bc793e11e2800a8c0c696e8b46742033/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-23T23:52:35.225 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:52:35.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-23T23:52:35.326 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-23T23:52:35.326 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3be9a5c9bc793e11e2800a8c0c696e8b46742033/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-23T23:52:35.334 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-23T23:52:35.335 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3be9a5c9bc793e11e2800a8c0c696e8b46742033/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-23T23:52:35.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-23T23:52:35.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-23T23:52:35.606 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-23T23:52:35.611 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-23T23:52:35.696 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-03-23T23:52:35.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-03-23T23:52:35.706 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2024-03-23T23:52:35.711 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2024-03-23T23:52:36.071 INFO:teuthology.orchestra.run.smithi059.stdout:74 files removed 2024-03-23T23:52:36.081 INFO:teuthology.orchestra.run.smithi031.stdout:74 files removed 2024-03-23T23:52:36.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-23T23:52:36.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-23T23:52:37.559 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 90 kB/s | 83 kB 00:00 2024-03-23T23:52:37.659 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 82 kB/s | 83 kB 00:01 2024-03-23T23:52:38.443 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 13 kB/s | 10 kB 00:00 2024-03-23T23:52:38.517 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 13 kB/s | 10 kB 00:00 2024-03-23T23:52:39.369 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2024-03-23T23:52:39.376 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-03-23T23:52:40.064 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-23T23:52:40.188 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - AppStream 9.1 MB/s | 6.7 MB 00:00 2024-03-23T23:52:41.765 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2024-03-23T23:52:41.889 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2024-03-23T23:52:42.934 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-03-23T23:52:42.944 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-03-23T23:52:45.470 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-03-23T23:52:50.196 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 6.1 MB 00:00 2024-03-23T23:52:52.050 INFO:teuthology.orchestra.run.smithi031.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 16 kB 00:00 2024-03-23T23:52:53.762 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-23T23:52:59.798 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-23T23:53:02.464 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T23:53:02.465 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T23:53:02.487 INFO:teuthology.orchestra.run.smithi031.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-23T23:53:02.488 INFO:teuthology.orchestra.run.smithi031.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-23T23:53:02.489 INFO:teuthology.orchestra.run.smithi031.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-23T23:53:02.491 INFO:teuthology.orchestra.run.smithi031.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-23T23:53:02.493 INFO:teuthology.orchestra.run.smithi031.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-23T23:53:02.497 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-23T23:53:02.498 INFO:teuthology.orchestra.run.smithi031.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-23T23:53:02.592 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2024-03-23T23:53:02.629 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2024-03-23T23:53:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 6.6 k 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.4 M 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 890 k 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 145 k 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 1.5 M 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 139 k 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 1.8 M 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 7.4 M 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 49 k 2024-03-23T23:53:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 9.9 M 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 48 M 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 264 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 748 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 220 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 27 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 18 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 31 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 746 k 2024-03-23T23:53:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 127 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 162 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 321 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 298 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 99 k 2024-03-23T23:53:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 85 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 170 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-23T23:53:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.4 M 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-23T23:53:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-23T23:53:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 20 M 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 34 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 2.3 M 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 248 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 4.7 M 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 17 M 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 16 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 25 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-23T23:53:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 163 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 501 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.1 M 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-23T23:53:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-23T23:53:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 45 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 131 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-23T23:53:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-23T23:53:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-23T23:53:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-23T23:53:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-23T23:53:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout:Installing weak dependencies: 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================================ 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout:Install 150 Packages 2024-03-23T23:53:02.644 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 24 Packages 2024-03-23T23:53:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:53:02.645 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 224 M 2024-03-23T23:53:02.645 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2024-03-23T23:53:03.550 INFO:teuthology.orchestra.run.smithi031.stdout:(1/174): ceph-19.0.0-2145.g3be9a5c9.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-03-23T23:53:04.534 INFO:teuthology.orchestra.run.smithi031.stdout:(2/174): ceph-fuse-19.0.0-2145.g3be9a5c9.el9.x8 907 kB/s | 890 kB 00:00 2024-03-23T23:53:04.683 INFO:teuthology.orchestra.run.smithi031.stdout:(3/174): ceph-immutable-object-cache-19.0.0-214 974 kB/s | 145 kB 00:00 2024-03-23T23:53:05.150 INFO:teuthology.orchestra.run.smithi031.stdout:(4/174): ceph-base-19.0.0-2145.g3be9a5c9.el9.x8 2.7 MB/s | 5.4 MB 00:01 2024-03-23T23:53:05.517 INFO:teuthology.orchestra.run.smithi031.stdout:(5/174): ceph-mgr-19.0.0-2145.g3be9a5c9.el9.x86 4.1 MB/s | 1.5 MB 00:00 2024-03-23T23:53:05.584 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 900 kB/s | 19 MB 00:21 2024-03-23T23:53:06.109 INFO:teuthology.orchestra.run.smithi031.stdout:(6/174): ceph-mds-19.0.0-2145.g3be9a5c9.el9.x86 1.6 MB/s | 2.3 MB 00:01 2024-03-23T23:53:06.418 INFO:teuthology.orchestra.run.smithi031.stdout:(7/174): ceph-mon-19.0.0-2145.g3be9a5c9.el9.x86 5.2 MB/s | 4.7 MB 00:00 2024-03-23T23:53:08.193 INFO:teuthology.orchestra.run.smithi031.stdout:(8/174): ceph-radosgw-19.0.0-2145.g3be9a5c9.el9 5.6 MB/s | 9.9 MB 00:01 2024-03-23T23:53:08.268 INFO:teuthology.orchestra.run.smithi031.stdout:(9/174): ceph-selinux-19.0.0-2145.g3be9a5c9.el9 341 kB/s | 25 kB 00:00 2024-03-23T23:53:10.227 INFO:teuthology.orchestra.run.smithi031.stdout:(10/174): ceph-common-19.0.0-2145.g3be9a5c9.el9 2.9 MB/s | 20 MB 00:07 2024-03-23T23:53:10.302 INFO:teuthology.orchestra.run.smithi031.stdout:(11/174): cephfs-mirror-19.0.0-2145.g3be9a5c9.e 2.9 MB/s | 220 kB 00:00 2024-03-23T23:53:10.361 INFO:teuthology.orchestra.run.smithi031.stdout:(12/174): cephfs-shell-19.0.0-2145.g3be9a5c9.el 469 kB/s | 27 kB 00:00 2024-03-23T23:53:10.419 INFO:teuthology.orchestra.run.smithi031.stdout:(13/174): libcephfs-devel-19.0.0-2145.g3be9a5c9 545 kB/s | 31 kB 00:00 2024-03-23T23:53:10.561 INFO:teuthology.orchestra.run.smithi031.stdout:(14/174): libcephfs2-19.0.0-2145.g3be9a5c9.el9. 5.2 MB/s | 746 kB 00:00 2024-03-23T23:53:10.614 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.1 MB 00:01 2024-03-23T23:53:10.620 INFO:teuthology.orchestra.run.smithi031.stdout:(15/174): libcephsqlite-19.0.0-2145.g3be9a5c9.e 2.8 MB/s | 163 kB 00:00 2024-03-23T23:53:10.678 INFO:teuthology.orchestra.run.smithi031.stdout:(16/174): librados-devel-19.0.0-2145.g3be9a5c9. 2.2 MB/s | 127 kB 00:00 2024-03-23T23:53:10.795 INFO:teuthology.orchestra.run.smithi031.stdout:(17/174): libradosstriper1-19.0.0-2145.g3be9a5c 4.2 MB/s | 501 kB 00:00 2024-03-23T23:53:11.279 INFO:teuthology.orchestra.run.smithi031.stdout:(18/174): ceph-osd-19.0.0-2145.g3be9a5c9.el9.x8 3.3 MB/s | 17 MB 00:05 2024-03-23T23:53:11.330 INFO:teuthology.orchestra.run.smithi031.stdout:(19/174): python3-ceph-argparse-19.0.0-2145.g3b 925 kB/s | 45 kB 00:00 2024-03-23T23:53:11.413 INFO:teuthology.orchestra.run.smithi031.stdout:(20/174): python3-ceph-common-19.0.0-2145.g3be9 1.6 MB/s | 131 kB 00:00 2024-03-23T23:53:11.497 INFO:teuthology.orchestra.run.smithi031.stdout:(21/174): python3-cephfs-19.0.0-2145.g3be9a5c9. 1.9 MB/s | 162 kB 00:00 2024-03-23T23:53:11.588 INFO:teuthology.orchestra.run.smithi031.stdout:(22/174): python3-rados-19.0.0-2145.g3be9a5c9.e 3.5 MB/s | 321 kB 00:00 2024-03-23T23:53:11.739 INFO:teuthology.orchestra.run.smithi031.stdout:(23/174): librgw2-19.0.0-2145.g3be9a5c9.el9.x86 5.5 MB/s | 5.1 MB 00:00 2024-03-23T23:53:11.772 INFO:teuthology.orchestra.run.smithi031.stdout:(24/174): python3-rbd-19.0.0-2145.g3be9a5c9.el9 1.6 MB/s | 298 kB 00:00 2024-03-23T23:53:11.806 INFO:teuthology.orchestra.run.smithi031.stdout:(25/174): python3-rgw-19.0.0-2145.g3be9a5c9.el9 1.5 MB/s | 99 kB 00:00 2024-03-23T23:53:11.831 INFO:teuthology.orchestra.run.smithi031.stdout:(26/174): rbd-fuse-19.0.0-2145.g3be9a5c9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-03-23T23:53:11.890 INFO:teuthology.orchestra.run.smithi031.stdout:(27/174): rbd-nbd-19.0.0-2145.g3be9a5c9.el9.x86 2.9 MB/s | 170 kB 00:00 2024-03-23T23:53:11.940 INFO:teuthology.orchestra.run.smithi031.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2145.g 692 kB/s | 34 kB 00:00 2024-03-23T23:53:12.007 INFO:teuthology.orchestra.run.smithi031.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2145.g3be9a5c 2.1 MB/s | 139 kB 00:00 2024-03-23T23:53:12.093 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 16 kB 00:00 2024-03-23T23:53:12.291 INFO:teuthology.orchestra.run.smithi031.stdout:(30/174): rbd-mirror-19.0.0-2145.g3be9a5c9.el9. 6.4 MB/s | 3.1 MB 00:00 2024-03-23T23:53:12.375 INFO:teuthology.orchestra.run.smithi031.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2145.g3be9a 4.9 MB/s | 1.8 MB 00:00 2024-03-23T23:53:12.450 INFO:teuthology.orchestra.run.smithi031.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2145.g3b 3.3 MB/s | 248 kB 00:00 2024-03-23T23:53:12.508 INFO:teuthology.orchestra.run.smithi031.stdout:(33/174): ceph-mgr-rook-19.0.0-2145.g3be9a5c9.e 859 kB/s | 49 kB 00:00 2024-03-23T23:53:12.567 INFO:teuthology.orchestra.run.smithi031.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2145.g3 286 kB/s | 16 kB 00:00 2024-03-23T23:53:12.651 INFO:teuthology.orchestra.run.smithi031.stdout:(35/174): ceph-volume-19.0.0-2145.g3be9a5c9.el9 3.1 MB/s | 264 kB 00:00 2024-03-23T23:53:12.801 INFO:teuthology.orchestra.run.smithi031.stdout:(36/174): cephadm-19.0.0-2145.g3be9a5c9.el9.noa 4.9 MB/s | 748 kB 00:00 2024-03-23T23:53:12.860 INFO:teuthology.orchestra.run.smithi031.stdout:(37/174): cephfs-top-19.0.0-2145.g3be9a5c9.el9. 318 kB/s | 18 kB 00:00 2024-03-23T23:53:13.060 INFO:teuthology.orchestra.run.smithi031.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2024-03-23T23:53:13.127 INFO:teuthology.orchestra.run.smithi031.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-03-23T23:53:13.169 INFO:teuthology.orchestra.run.smithi031.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-03-23T23:53:13.219 INFO:teuthology.orchestra.run.smithi031.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-03-23T23:53:13.262 INFO:teuthology.orchestra.run.smithi031.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 777 kB/s | 32 kB 00:00 2024-03-23T23:53:13.420 INFO:teuthology.orchestra.run.smithi031.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-03-23T23:53:13.554 INFO:teuthology.orchestra.run.smithi031.stdout:(44/174): ceph-mgr-diskprediction-local-19.0.0- 5.9 MB/s | 7.4 MB 00:01 2024-03-23T23:53:13.587 INFO:teuthology.orchestra.run.smithi031.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 103 kB/s | 17 kB 00:00 2024-03-23T23:53:13.613 INFO:teuthology.orchestra.run.smithi031.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 175 kB/s | 10 kB 00:00 2024-03-23T23:53:13.638 INFO:teuthology.orchestra.run.smithi031.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2024-03-23T23:53:13.663 INFO:teuthology.orchestra.run.smithi031.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 920 kB/s | 44 kB 00:00 2024-03-23T23:53:13.705 INFO:teuthology.orchestra.run.smithi031.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-03-23T23:53:13.739 INFO:teuthology.orchestra.run.smithi031.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.2 MB/s | 578 kB 00:00 2024-03-23T23:53:13.764 INFO:teuthology.orchestra.run.smithi031.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 881 kB/s | 46 kB 00:00 2024-03-23T23:53:13.798 INFO:teuthology.orchestra.run.smithi031.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-23T23:53:13.823 INFO:teuthology.orchestra.run.smithi031.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.3 MB/s | 187 kB 00:00 2024-03-23T23:53:13.857 INFO:teuthology.orchestra.run.smithi031.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2024-03-23T23:53:13.891 INFO:teuthology.orchestra.run.smithi031.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 530 kB/s | 34 kB 00:00 2024-03-23T23:53:14.041 INFO:teuthology.orchestra.run.smithi031.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-03-23T23:53:14.091 INFO:teuthology.orchestra.run.smithi031.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 8.4 MB/s | 1.5 MB 00:00 2024-03-23T23:53:14.133 INFO:teuthology.orchestra.run.smithi031.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 8.7 MB/s | 811 kB 00:00 2024-03-23T23:53:14.158 INFO:teuthology.orchestra.run.smithi031.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2024-03-23T23:53:14.317 INFO:teuthology.orchestra.run.smithi031.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2024-03-23T23:53:14.351 INFO:teuthology.orchestra.run.smithi031.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-03-23T23:53:14.393 INFO:teuthology.orchestra.run.smithi031.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2024-03-23T23:53:14.561 INFO:teuthology.orchestra.run.smithi031.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-03-23T23:53:14.593 INFO:teuthology.orchestra.run.smithi031.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 133 kB/s | 24 kB 00:00 2024-03-23T23:53:14.627 INFO:teuthology.orchestra.run.smithi031.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 559 kB/s | 18 kB 00:00 2024-03-23T23:53:14.652 INFO:teuthology.orchestra.run.smithi031.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-03-23T23:53:14.669 INFO:teuthology.orchestra.run.smithi031.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 768 kB/s | 32 kB 00:00 2024-03-23T23:53:14.795 INFO:teuthology.orchestra.run.smithi031.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-03-23T23:53:14.820 INFO:teuthology.orchestra.run.smithi031.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2024-03-23T23:53:14.862 INFO:teuthology.orchestra.run.smithi031.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-03-23T23:53:14.887 INFO:teuthology.orchestra.run.smithi031.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-03-23T23:53:14.920 INFO:teuthology.orchestra.run.smithi031.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-03-23T23:53:14.954 INFO:teuthology.orchestra.run.smithi031.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-03-23T23:53:14.979 INFO:teuthology.orchestra.run.smithi031.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-23T23:53:15.021 INFO:teuthology.orchestra.run.smithi031.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 211 kB 00:00 2024-03-23T23:53:15.038 INFO:teuthology.orchestra.run.smithi031.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 846 kB/s | 47 kB 00:00 2024-03-23T23:53:15.055 INFO:teuthology.orchestra.run.smithi031.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-03-23T23:53:15.597 INFO:teuthology.orchestra.run.smithi031.stdout:(78/174): ceph-test-19.0.0-2145.g3be9a5c9.el9.x 6.5 MB/s | 48 MB 00:07 2024-03-23T23:53:15.623 INFO:teuthology.orchestra.run.smithi031.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 70 kB/s | 39 kB 00:00 2024-03-23T23:53:15.848 INFO:teuthology.orchestra.run.smithi031.stdout:(80/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-03-23T23:53:15.865 INFO:teuthology.orchestra.run.smithi031.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 159 kB/s | 41 kB 00:00 2024-03-23T23:53:15.898 INFO:teuthology.orchestra.run.smithi031.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2024-03-23T23:53:15.915 INFO:teuthology.orchestra.run.smithi031.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 1.2 MB/s | 56 kB 00:00 2024-03-23T23:53:15.932 INFO:teuthology.orchestra.run.smithi031.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 998 kB/s | 63 kB 00:00 2024-03-23T23:53:15.949 INFO:teuthology.orchestra.run.smithi031.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 908 kB/s | 44 kB 00:00 2024-03-23T23:53:15.983 INFO:teuthology.orchestra.run.smithi031.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-23T23:53:16.010 INFO:teuthology.orchestra.run.smithi031.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2024-03-23T23:53:16.066 INFO:teuthology.orchestra.run.smithi031.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2024-03-23T23:53:16.092 INFO:teuthology.orchestra.run.smithi031.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-23T23:53:16.117 INFO:teuthology.orchestra.run.smithi031.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2024-03-23T23:53:16.151 INFO:teuthology.orchestra.run.smithi031.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 187 kB 00:00 2024-03-23T23:53:16.409 INFO:teuthology.orchestra.run.smithi031.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 647 kB/s | 187 kB 00:00 2024-03-23T23:53:16.443 INFO:teuthology.orchestra.run.smithi031.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 671 kB/s | 195 kB 00:00 2024-03-23T23:53:16.544 INFO:teuthology.orchestra.run.smithi031.stdout:(94/174): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-03-23T23:53:16.594 INFO:teuthology.orchestra.run.smithi031.stdout:(95/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 515 kB/s | 25 kB 00:00 2024-03-23T23:53:16.864 INFO:teuthology.orchestra.run.smithi031.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 15 MB/s | 4.1 MB 00:00 2024-03-23T23:53:16.920 INFO:teuthology.orchestra.run.smithi031.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 4.4 MB/s | 245 kB 00:00 2024-03-23T23:53:16.970 INFO:teuthology.orchestra.run.smithi031.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-03-23T23:53:17.012 INFO:teuthology.orchestra.run.smithi031.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 5.2 MB/s | 216 kB 00:00 2024-03-23T23:53:17.062 INFO:teuthology.orchestra.run.smithi031.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 707 kB/s | 35 kB 00:00 2024-03-23T23:53:17.112 INFO:teuthology.orchestra.run.smithi031.stdout:(101/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 900 kB/s | 44 kB 00:00 2024-03-23T23:53:17.163 INFO:teuthology.orchestra.run.smithi031.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-03-23T23:53:17.380 INFO:teuthology.orchestra.run.smithi031.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 103 kB/s | 22 kB 00:00 2024-03-23T23:53:17.513 INFO:teuthology.orchestra.run.smithi031.stdout:(104/174): libgfortran-11.4.1-3.el9.x86_64.rpm 576 kB/s | 803 kB 00:01 2024-03-23T23:53:17.580 INFO:teuthology.orchestra.run.smithi031.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-03-23T23:53:17.605 INFO:teuthology.orchestra.run.smithi031.stdout:(106/174): python3-requests-2.25.1-8.el9.noarch 104 kB/s | 125 kB 00:01 2024-03-23T23:53:17.897 INFO:teuthology.orchestra.run.smithi031.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 67 kB/s | 19 kB 00:00 2024-03-23T23:53:18.331 INFO:teuthology.orchestra.run.smithi031.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 412 kB/s | 309 kB 00:00 2024-03-23T23:53:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-03-23T23:53:18.557 INFO:teuthology.orchestra.run.smithi031.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 418 kB/s | 49 kB 00:00 2024-03-23T23:53:18.674 INFO:teuthology.orchestra.run.smithi031.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 581 kB/s | 67 kB 00:00 2024-03-23T23:53:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:(112/174): abseil-cpp-20211102.0-3.el9.x86_64.r 453 kB/s | 548 kB 00:01 2024-03-23T23:53:18.982 INFO:teuthology.orchestra.run.smithi031.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 490 kB/s | 151 kB 00:00 2024-03-23T23:53:19.766 INFO:teuthology.orchestra.run.smithi031.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 700 kB/s | 548 kB 00:00 2024-03-23T23:53:19.799 INFO:teuthology.orchestra.run.smithi031.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 780 kB/s | 838 kB 00:01 2024-03-23T23:53:19.875 INFO:teuthology.orchestra.run.smithi031.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 403 kB/s | 43 kB 00:00 2024-03-23T23:53:19.908 INFO:teuthology.orchestra.run.smithi031.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 298 kB/s | 32 kB 00:00 2024-03-23T23:53:20.000 INFO:teuthology.orchestra.run.smithi031.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2024-03-23T23:53:20.217 INFO:teuthology.orchestra.run.smithi031.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 557 kB/s | 172 kB 00:00 2024-03-23T23:53:20.476 INFO:teuthology.orchestra.run.smithi031.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 756 kB/s | 358 kB 00:00 2024-03-23T23:53:20.594 INFO:teuthology.orchestra.run.smithi031.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 302 kB/s | 35 kB 00:00 2024-03-23T23:53:20.636 INFO:teuthology.orchestra.run.smithi031.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 726 kB/s | 303 kB 00:00 2024-03-23T23:53:20.919 INFO:teuthology.orchestra.run.smithi031.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 625 kB/s | 203 kB 00:00 2024-03-23T23:53:21.136 INFO:teuthology.orchestra.run.smithi031.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 668 kB/s | 144 kB 00:00 2024-03-23T23:53:21.253 INFO:teuthology.orchestra.run.smithi031.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2024-03-23T23:53:21.370 INFO:teuthology.orchestra.run.smithi031.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-03-23T23:53:21.587 INFO:teuthology.orchestra.run.smithi031.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 107 kB/s | 23 kB 00:00 2024-03-23T23:53:21.704 INFO:teuthology.orchestra.run.smithi031.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 168 kB/s | 19 kB 00:00 2024-03-23T23:53:21.822 INFO:teuthology.orchestra.run.smithi031.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2024-03-23T23:53:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 848 kB/s | 1.0 MB 00:01 2024-03-23T23:53:23.230 INFO:teuthology.orchestra.run.smithi031.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 804 kB/s | 2.0 MB 00:02 2024-03-23T23:53:23.256 INFO:teuthology.orchestra.run.smithi031.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 234 kB/s | 46 kB 00:00 2024-03-23T23:53:23.373 INFO:teuthology.orchestra.run.smithi031.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 560 kB/s | 79 kB 00:00 2024-03-23T23:53:23.398 INFO:teuthology.orchestra.run.smithi031.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 408 kB/s | 58 kB 00:00 2024-03-23T23:53:23.515 INFO:teuthology.orchestra.run.smithi031.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2024-03-23T23:53:23.649 INFO:teuthology.orchestra.run.smithi031.stdout:(136/174): libarrow-9.0.0-10.el9.x86_64.rpm 787 kB/s | 4.4 MB 00:05 2024-03-23T23:53:23.791 INFO:teuthology.orchestra.run.smithi031.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 327 kB/s | 90 kB 00:00 2024-03-23T23:53:23.816 INFO:teuthology.orchestra.run.smithi031.stdout:(138/174): python3-pecan-1.4.2-3.el9.noarch.rpm 616 kB/s | 272 kB 00:00 2024-03-23T23:53:23.841 INFO:teuthology.orchestra.run.smithi031.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 147 kB/s | 28 kB 00:00 2024-03-23T23:53:23.908 INFO:teuthology.orchestra.run.smithi031.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 264 kB/s | 31 kB 00:00 2024-03-23T23:53:23.967 INFO:teuthology.orchestra.run.smithi031.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 476 kB/s | 59 kB 00:00 2024-03-23T23:53:24.025 INFO:teuthology.orchestra.run.smithi031.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-03-23T23:53:24.234 INFO:teuthology.orchestra.run.smithi031.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 191 kB/s | 51 kB 00:00 2024-03-23T23:53:24.259 INFO:teuthology.orchestra.run.smithi031.stdout:(144/174): python3-routes-2.5.1-5.el9.noarch.rp 452 kB/s | 188 kB 00:00 2024-03-23T23:53:24.376 INFO:teuthology.orchestra.run.smithi031.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 635 kB/s | 90 kB 00:00 2024-03-23T23:53:24.443 INFO:teuthology.orchestra.run.smithi031.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 551 kB/s | 230 kB 00:00 2024-03-23T23:53:24.485 INFO:teuthology.orchestra.run.smithi031.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-03-23T23:53:24.744 INFO:teuthology.orchestra.run.smithi031.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 639 kB/s | 192 kB 00:00 2024-03-23T23:53:24.860 INFO:teuthology.orchestra.run.smithi031.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 711 kB/s | 427 kB 00:00 2024-03-23T23:53:25.286 INFO:teuthology.orchestra.run.smithi031.stdout:(150/174): librbd1-19.0.0-2145.g3be9a5c9.el9.x8 7.4 MB/s | 3.1 MB 00:00 2024-03-23T23:53:25.369 INFO:teuthology.orchestra.run.smithi031.stdout:(151/174): librados2-19.0.0-2145.g3be9a5c9.el9. 5.4 MB/s | 3.4 MB 00:00 2024-03-23T23:53:25.403 INFO:teuthology.orchestra.run.smithi031.stdout:(152/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 321 kB 00:00 2024-03-23T23:53:26.279 INFO:teuthology.orchestra.run.smithi031.stdout:(153/174): thrift-0.15.0-2.el9.x86_64.rpm 903 kB/s | 1.6 MB 00:01 2024-03-23T23:53:26.704 INFO:teuthology.orchestra.run.smithi031.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 99 kB/s | 42 kB 00:00 2024-03-23T23:53:27.170 INFO:teuthology.orchestra.run.smithi031.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 533 kB/s | 248 kB 00:00 2024-03-23T23:53:27.829 INFO:teuthology.orchestra.run.smithi031.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 108 kB/s | 71 kB 00:00 2024-03-23T23:53:27.996 INFO:teuthology.orchestra.run.smithi031.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 220 kB/s | 36 kB 00:00 2024-03-23T23:53:28.980 INFO:teuthology.orchestra.run.smithi031.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 196 kB/s | 192 kB 00:00 2024-03-23T23:53:29.930 INFO:teuthology.orchestra.run.smithi031.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 269 kB/s | 256 kB 00:00 2024-03-23T23:53:30.014 INFO:teuthology.orchestra.run.smithi031.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 279 kB/s | 23 kB 00:00 2024-03-23T23:53:30.231 INFO:teuthology.orchestra.run.smithi031.stdout:(161/174): NetworkManager-libnm-1.47.2-1.el9.x8 389 kB/s | 1.8 MB 00:04 2024-03-23T23:53:30.298 INFO:teuthology.orchestra.run.smithi031.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 383 kB/s | 108 kB 00:00 2024-03-23T23:53:30.923 INFO:teuthology.orchestra.run.smithi031.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 224 kB/s | 155 kB 00:00 2024-03-23T23:53:30.948 INFO:teuthology.orchestra.run.smithi031.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 209 kB/s | 136 kB 00:00 2024-03-23T23:53:31.032 INFO:teuthology.orchestra.run.smithi031.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 347 kB/s | 29 kB 00:00 2024-03-23T23:53:31.124 INFO:teuthology.orchestra.run.smithi031.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 320 kB/s | 64 kB 00:00 2024-03-23T23:53:31.282 INFO:teuthology.orchestra.run.smithi031.stdout:(167/174): NetworkManager-1.47.2-1.el9.x86_64.r 399 kB/s | 2.3 MB 00:05 2024-03-23T23:53:32.891 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 21 MB 00:20 2024-03-23T23:53:33.499 INFO:teuthology.orchestra.run.smithi031.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 502 kB/s | 1.2 MB 00:02 2024-03-23T23:53:33.862 INFO:teuthology.orchestra.run.smithi031.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 1.3 MB/s | 465 kB 00:00 2024-03-23T23:53:33.921 INFO:teuthology.orchestra.run.smithi031.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 541 kB/s | 31 kB 00:00 2024-03-23T23:53:34.104 INFO:teuthology.orchestra.run.smithi031.stdout:(171/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 741 kB/s | 2.2 MB 00:02 2024-03-23T23:53:34.254 INFO:teuthology.orchestra.run.smithi031.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 787 kB/s | 2.3 MB 00:02 2024-03-23T23:53:34.279 INFO:teuthology.orchestra.run.smithi031.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 427 kB/s | 74 kB 00:00 2024-03-23T23:53:34.521 INFO:teuthology.orchestra.run.smithi031.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 1.1 MB 00:00 2024-03-23T23:53:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2024-03-23T23:53:34.526 INFO:teuthology.orchestra.run.smithi031.stdout:Total 7.0 MB/s | 224 MB 00:31 2024-03-23T23:53:35.936 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2024-03-23T23:53:36.337 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2024-03-23T23:53:36.337 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2024-03-23T23:53:38.743 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2024-03-23T23:53:38.744 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2024-03-23T23:53:38.827 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-23T23:53:41.481 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T23:53:41.483 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T23:53:41.506 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-23T23:53:41.507 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-23T23:53:41.509 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-23T23:53:41.510 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-23T23:53:41.513 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-23T23:53:41.517 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-23T23:53:41.518 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-23T23:53:41.619 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-03-23T23:53:41.641 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2024-03-23T23:53:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-03-23T23:53:41.641 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2024-03-23T23:53:41.641 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-03-23T23:53:41.641 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 6.6 k 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.4 M 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 890 k 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 145 k 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 1.5 M 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 139 k 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 1.8 M 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 7.4 M 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 49 k 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 9.9 M 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 48 M 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 264 k 2024-03-23T23:53:41.642 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 748 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 220 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 27 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 18 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 31 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 746 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 127 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-23T23:53:41.643 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 162 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 321 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 298 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 99 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 85 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 170 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-23T23:53:41.644 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.4 M 2024-03-23T23:53:41.645 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 3.1 M 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-23T23:53:41.646 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 20 M 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 34 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 2.3 M 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 248 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 4.7 M 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 17 M 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2145.g3be9a5c9.el9 ceph-noarch 16 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 25 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-23T23:53:41.647 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 163 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 501 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 5.1 M 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-23T23:53:41.648 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-23T23:53:41.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 45 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.0.0-2145.g3be9a5c9.el9 ceph 131 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-23T23:53:41.650 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-23T23:53:41.651 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-23T23:53:41.652 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-23T23:53:41.653 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-23T23:53:41.654 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout:Install 150 Packages 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 24 Packages 2024-03-23T23:53:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:53:41.656 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 224 M 2024-03-23T23:53:41.656 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-03-23T23:53:42.471 INFO:teuthology.orchestra.run.smithi059.stdout:(1/174): ceph-19.0.0-2145.g3be9a5c9.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-03-23T23:53:42.681 INFO:teuthology.orchestra.run.smithi059.stdout:(2/174): ceph-fuse-19.0.0-2145.g3be9a5c9.el9.x8 4.2 MB/s | 890 kB 00:00 2024-03-23T23:53:42.746 INFO:teuthology.orchestra.run.smithi059.stdout:(3/174): ceph-immutable-object-cache-19.0.0-214 2.2 MB/s | 145 kB 00:00 2024-03-23T23:53:43.088 INFO:teuthology.orchestra.run.smithi059.stdout:(4/174): ceph-mds-19.0.0-2145.g3be9a5c9.el9.x86 6.8 MB/s | 2.3 MB 00:00 2024-03-23T23:53:43.338 INFO:teuthology.orchestra.run.smithi059.stdout:(5/174): ceph-base-19.0.0-2145.g3be9a5c9.el9.x8 4.8 MB/s | 5.4 MB 00:01 2024-03-23T23:53:43.397 INFO:teuthology.orchestra.run.smithi059.stdout:(6/174): ceph-mgr-19.0.0-2145.g3be9a5c9.el9.x86 4.9 MB/s | 1.5 MB 00:00 2024-03-23T23:53:44.055 INFO:teuthology.orchestra.run.smithi059.stdout:(7/174): ceph-mon-19.0.0-2145.g3be9a5c9.el9.x86 6.6 MB/s | 4.7 MB 00:00 2024-03-23T23:53:44.331 INFO:teuthology.orchestra.run.smithi059.stdout:(8/174): ceph-common-19.0.0-2145.g3be9a5c9.el9. 9.7 MB/s | 20 MB 00:02 2024-03-23T23:53:44.397 INFO:teuthology.orchestra.run.smithi059.stdout:(9/174): ceph-selinux-19.0.0-2145.g3be9a5c9.el9 384 kB/s | 25 kB 00:00 2024-03-23T23:53:45.539 INFO:teuthology.orchestra.run.smithi059.stdout:(10/174): ceph-osd-19.0.0-2145.g3be9a5c9.el9.x8 7.9 MB/s | 17 MB 00:02 2024-03-23T23:53:45.731 INFO:teuthology.orchestra.run.smithi059.stdout:(11/174): ceph-radosgw-19.0.0-2145.g3be9a5c9.el 5.9 MB/s | 9.9 MB 00:01 2024-03-23T23:53:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:(12/174): cephfs-mirror-19.0.0-2145.g3be9a5c9.e 885 kB/s | 220 kB 00:00 2024-03-23T23:53:45.815 INFO:teuthology.orchestra.run.smithi059.stdout:(13/174): cephfs-shell-19.0.0-2145.g3be9a5c9.el 328 kB/s | 27 kB 00:00 2024-03-23T23:53:45.840 INFO:teuthology.orchestra.run.smithi059.stdout:(14/174): libcephfs-devel-19.0.0-2145.g3be9a5c9 635 kB/s | 31 kB 00:00 2024-03-23T23:53:45.940 INFO:teuthology.orchestra.run.smithi059.stdout:(15/174): libcephsqlite-19.0.0-2145.g3be9a5c9.e 1.6 MB/s | 163 kB 00:00 2024-03-23T23:53:46.024 INFO:teuthology.orchestra.run.smithi059.stdout:(16/174): libcephfs2-19.0.0-2145.g3be9a5c9.el9. 3.5 MB/s | 746 kB 00:00 2024-03-23T23:53:46.082 INFO:teuthology.orchestra.run.smithi059.stdout:(17/174): librados-devel-19.0.0-2145.g3be9a5c9. 905 kB/s | 127 kB 00:00 2024-03-23T23:53:46.150 INFO:teuthology.orchestra.run.smithi059.stdout:(18/174): libradosstriper1-19.0.0-2145.g3be9a5c 3.9 MB/s | 501 kB 00:00 2024-03-23T23:53:46.162 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2024-03-23T23:53:46.217 INFO:teuthology.orchestra.run.smithi059.stdout:(19/174): python3-ceph-argparse-19.0.0-2145.g3b 684 kB/s | 45 kB 00:00 2024-03-23T23:53:46.296 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-23T23:53:46.325 INFO:teuthology.orchestra.run.smithi059.stdout:(20/174): python3-ceph-common-19.0.0-2145.g3be9 1.2 MB/s | 131 kB 00:00 2024-03-23T23:53:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-23T23:53:46.365 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-23T23:53:46.408 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-23T23:53:46.451 INFO:teuthology.orchestra.run.smithi059.stdout:(21/174): python3-cephfs-19.0.0-2145.g3be9a5c9. 1.3 MB/s | 162 kB 00:00 2024-03-23T23:53:46.506 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-23T23:53:46.593 INFO:teuthology.orchestra.run.smithi059.stdout:(22/174): python3-rados-19.0.0-2145.g3be9a5c9.e 2.2 MB/s | 321 kB 00:00 2024-03-23T23:53:46.624 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-23T23:53:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-23T23:53:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-23T23:53:46.743 INFO:teuthology.orchestra.run.smithi059.stdout:(23/174): librgw2-19.0.0-2145.g3be9a5c9.el9.x86 7.8 MB/s | 5.1 MB 00:00 2024-03-23T23:53:46.776 INFO:teuthology.orchestra.run.smithi059.stdout:(24/174): python3-rbd-19.0.0-2145.g3be9a5c9.el9 1.6 MB/s | 298 kB 00:00 2024-03-23T23:53:46.810 INFO:teuthology.orchestra.run.smithi059.stdout:(25/174): python3-rgw-19.0.0-2145.g3be9a5c9.el9 1.5 MB/s | 99 kB 00:00 2024-03-23T23:53:46.828 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-23T23:53:46.860 INFO:teuthology.orchestra.run.smithi059.stdout:(26/174): rbd-fuse-19.0.0-2145.g3be9a5c9.el9.x8 1.0 MB/s | 85 kB 00:00 2024-03-23T23:53:46.986 INFO:teuthology.orchestra.run.smithi059.stdout:(27/174): rbd-nbd-19.0.0-2145.g3be9a5c9.el9.x86 1.3 MB/s | 170 kB 00:00 2024-03-23T23:53:47.120 INFO:teuthology.orchestra.run.smithi059.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2145.g 256 kB/s | 34 kB 00:00 2024-03-23T23:53:47.203 INFO:teuthology.orchestra.run.smithi059.stdout:(29/174): rbd-mirror-19.0.0-2145.g3be9a5c9.el9. 7.9 MB/s | 3.1 MB 00:00 2024-03-23T23:53:47.229 INFO:teuthology.orchestra.run.smithi059.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2145.g3be9a5c 1.3 MB/s | 139 kB 00:00 2024-03-23T23:53:47.285 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-23T23:53:47.328 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-23T23:53:47.471 INFO:teuthology.orchestra.run.smithi059.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2145.g3be9a 6.7 MB/s | 1.8 MB 00:00 2024-03-23T23:53:47.503 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-23T23:53:47.537 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-23T23:53:47.563 INFO:teuthology.orchestra.run.smithi059.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2145.g3b 2.7 MB/s | 248 kB 00:00 2024-03-23T23:53:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-23T23:53:47.666 INFO:teuthology.orchestra.run.smithi059.stdout:(33/174): ceph-mgr-rook-19.0.0-2145.g3be9a5c9.e 481 kB/s | 49 kB 00:00 2024-03-23T23:53:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-23T23:53:47.746 INFO:teuthology.orchestra.run.smithi059.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2145.g3 208 kB/s | 16 kB 00:00 2024-03-23T23:53:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-23T23:53:48.069 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-23T23:53:48.125 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-23T23:53:48.150 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-23T23:53:48.247 INFO:teuthology.orchestra.run.smithi059.stdout:(35/174): ceph-test-19.0.0-2145.g3be9a5c9.el9.x 12 MB/s | 48 MB 00:03 2024-03-23T23:53:48.302 INFO:teuthology.orchestra.run.smithi059.stdout:(36/174): ceph-volume-19.0.0-2145.g3be9a5c9.el9 475 kB/s | 264 kB 00:00 2024-03-23T23:53:48.304 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-23T23:53:48.335 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-23T23:53:48.364 INFO:teuthology.orchestra.run.smithi059.stdout:(37/174): cephadm-19.0.0-2145.g3be9a5c9.el9.noa 6.3 MB/s | 748 kB 00:00 2024-03-23T23:53:48.381 INFO:teuthology.orchestra.run.smithi059.stdout:(38/174): cephfs-top-19.0.0-2145.g3be9a5c9.el9. 236 kB/s | 18 kB 00:00 2024-03-23T23:53:48.425 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-23T23:53:48.479 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-23T23:53:48.503 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-23T23:53:48.560 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-23T23:53:48.623 INFO:teuthology.orchestra.run.smithi059.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 5.3 MB/s | 7.4 MB 00:01 2024-03-23T23:53:48.690 INFO:teuthology.orchestra.run.smithi059.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2024-03-23T23:53:48.716 INFO:teuthology.orchestra.run.smithi059.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 106 kB 00:00 2024-03-23T23:53:48.757 INFO:teuthology.orchestra.run.smithi059.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.7 MB/s | 307 kB 00:00 2024-03-23T23:53:48.782 INFO:teuthology.orchestra.run.smithi059.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 521 kB/s | 32 kB 00:00 2024-03-23T23:53:48.839 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-23T23:53:48.849 INFO:teuthology.orchestra.run.smithi059.stdout:(44/174): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 920 kB 00:00 2024-03-23T23:53:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-23T23:53:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-23T23:53:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 100 kB/s | 17 kB 00:00 2024-03-23T23:53:49.041 INFO:teuthology.orchestra.run.smithi059.stdout:(46/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-03-23T23:53:49.066 INFO:teuthology.orchestra.run.smithi059.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 48 kB/s | 10 kB 00:00 2024-03-23T23:53:49.100 INFO:teuthology.orchestra.run.smithi059.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2024-03-23T23:53:49.134 INFO:teuthology.orchestra.run.smithi059.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 686 kB/s | 44 kB 00:00 2024-03-23T23:53:49.175 INFO:teuthology.orchestra.run.smithi059.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.1 MB/s | 661 kB 00:00 2024-03-23T23:53:49.209 INFO:teuthology.orchestra.run.smithi059.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 5.5 MB/s | 578 kB 00:00 2024-03-23T23:53:49.234 INFO:teuthology.orchestra.run.smithi059.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 496 kB/s | 46 kB 00:00 2024-03-23T23:53:49.251 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-23T23:53:49.268 INFO:teuthology.orchestra.run.smithi059.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2024-03-23T23:53:49.301 INFO:teuthology.orchestra.run.smithi059.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-23T23:53:49.327 INFO:teuthology.orchestra.run.smithi059.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2024-03-23T23:53:49.352 INFO:teuthology.orchestra.run.smithi059.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 430 kB/s | 34 kB 00:00 2024-03-23T23:53:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-23T23:53:49.461 INFO:teuthology.orchestra.run.smithi059.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-03-23T23:53:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-23T23:53:49.544 INFO:teuthology.orchestra.run.smithi059.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 4.2 MB/s | 811 kB 00:00 2024-03-23T23:53:49.694 INFO:teuthology.orchestra.run.smithi059.stdout:(59/174): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-03-23T23:53:49.720 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-23T23:53:49.736 INFO:teuthology.orchestra.run.smithi059.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 508 kB/s | 134 kB 00:00 2024-03-23T23:53:49.796 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-23T23:53:49.870 INFO:teuthology.orchestra.run.smithi059.stdout:(61/174): postgresql-server-13.11-1.el9.x86_64. 18 MB/s | 5.7 MB 00:00 2024-03-23T23:53:49.912 INFO:teuthology.orchestra.run.smithi059.stdout:(62/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-03-23T23:53:49.937 INFO:teuthology.orchestra.run.smithi059.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 419 kB/s | 78 kB 00:00 2024-03-23T23:53:50.103 INFO:teuthology.orchestra.run.smithi059.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 149 kB/s | 24 kB 00:00 2024-03-23T23:53:50.119 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-23T23:53:50.212 INFO:teuthology.orchestra.run.smithi059.stdout:(65/174): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-03-23T23:53:50.238 INFO:teuthology.orchestra.run.smithi059.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 61 kB/s | 18 kB 00:00 2024-03-23T23:53:50.263 INFO:teuthology.orchestra.run.smithi059.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 947 kB/s | 144 kB 00:00 2024-03-23T23:53:50.303 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-23T23:53:50.305 INFO:teuthology.orchestra.run.smithi059.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 490 kB/s | 32 kB 00:00 2024-03-23T23:53:50.422 INFO:teuthology.orchestra.run.smithi059.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-03-23T23:53:50.439 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-23T23:53:50.447 INFO:teuthology.orchestra.run.smithi059.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-03-23T23:53:50.472 INFO:teuthology.orchestra.run.smithi059.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-03-23T23:53:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-23T23:53:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-23T23:53:50.514 INFO:teuthology.orchestra.run.smithi059.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-23T23:53:50.548 INFO:teuthology.orchestra.run.smithi059.stdout:(73/174): python3-packaging-20.9-5.el9.noarch.r 929 kB/s | 69 kB 00:00 2024-03-23T23:53:50.573 INFO:teuthology.orchestra.run.smithi059.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 238 kB 00:00 2024-03-23T23:53:50.573 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-23T23:53:50.598 INFO:teuthology.orchestra.run.smithi059.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2024-03-23T23:53:50.624 INFO:teuthology.orchestra.run.smithi059.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 991 kB/s | 47 kB 00:00 2024-03-23T23:53:50.657 INFO:teuthology.orchestra.run.smithi059.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-03-23T23:53:50.676 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-23T23:53:50.682 INFO:teuthology.orchestra.run.smithi059.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 519 kB/s | 43 kB 00:00 2024-03-23T23:53:50.746 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-23T23:53:50.796 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-23T23:53:50.920 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-23T23:53:50.966 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-23T23:53:51.030 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-23T23:53:51.080 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-23T23:53:51.119 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-23T23:53:51.124 INFO:teuthology.orchestra.run.smithi059.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-03-23T23:53:51.149 INFO:teuthology.orchestra.run.smithi059.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 85 kB/s | 39 kB 00:00 2024-03-23T23:53:51.174 INFO:teuthology.orchestra.run.smithi059.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 86 kB/s | 41 kB 00:00 2024-03-23T23:53:51.200 INFO:teuthology.orchestra.run.smithi059.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2024-03-23T23:53:51.230 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-23T23:53:51.233 INFO:teuthology.orchestra.run.smithi059.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-23T23:53:51.259 INFO:teuthology.orchestra.run.smithi059.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 784 kB/s | 63 kB 00:00 2024-03-23T23:53:51.264 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 39/198 2024-03-23T23:53:51.308 INFO:teuthology.orchestra.run.smithi059.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 410 kB/s | 44 kB 00:00 2024-03-23T23:53:51.318 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 40/198 2024-03-23T23:53:51.334 INFO:teuthology.orchestra.run.smithi059.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 795 kB/s | 79 kB 00:00 2024-03-23T23:53:51.346 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 41/198 2024-03-23T23:53:51.376 INFO:teuthology.orchestra.run.smithi059.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-23T23:53:51.418 INFO:teuthology.orchestra.run.smithi059.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-23T23:53:51.443 INFO:teuthology.orchestra.run.smithi059.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-03-23T23:53:51.467 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-23T23:53:51.477 INFO:teuthology.orchestra.run.smithi059.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.3 MB/s | 187 kB 00:00 2024-03-23T23:53:51.502 INFO:teuthology.orchestra.run.smithi059.stdout:(91/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-03-23T23:53:51.532 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-23T23:53:51.643 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-23T23:53:51.830 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-23T23:53:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-23T23:53:51.986 INFO:teuthology.orchestra.run.smithi059.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 347 kB/s | 187 kB 00:00 2024-03-23T23:53:52.028 INFO:teuthology.orchestra.run.smithi059.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 372 kB/s | 195 kB 00:00 2024-03-23T23:53:52.095 INFO:teuthology.orchestra.run.smithi059.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-03-23T23:53:52.120 INFO:teuthology.orchestra.run.smithi059.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 235 kB/s | 21 kB 00:00 2024-03-23T23:53:52.196 INFO:teuthology.orchestra.run.smithi059.stdout:(96/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 256 kB/s | 25 kB 00:00 2024-03-23T23:53:52.254 INFO:teuthology.orchestra.run.smithi059.stdout:(97/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-03-23T23:53:52.363 INFO:teuthology.orchestra.run.smithi059.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-03-23T23:53:52.421 INFO:teuthology.orchestra.run.smithi059.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 3.7 MB/s | 216 kB 00:00 2024-03-23T23:53:52.480 INFO:teuthology.orchestra.run.smithi059.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 605 kB/s | 35 kB 00:00 2024-03-23T23:53:52.530 INFO:teuthology.orchestra.run.smithi059.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 900 kB/s | 248 kB 00:00 2024-03-23T23:53:52.555 INFO:teuthology.orchestra.run.smithi059.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 598 kB/s | 44 kB 00:00 2024-03-23T23:53:52.597 INFO:teuthology.orchestra.run.smithi059.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-03-23T23:53:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-23T23:53:52.713 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-23T23:53:52.825 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-23T23:53:52.839 INFO:teuthology.orchestra.run.smithi059.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 5.8 MB/s | 4.1 MB 00:00 2024-03-23T23:53:52.883 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-23T23:53:52.908 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-23T23:53:52.947 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-23T23:53:53.015 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-23T23:53:53.067 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 53/198 2024-03-23T23:53:53.107 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-23T23:53:53.115 INFO:teuthology.orchestra.run.smithi059.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-03-23T23:53:53.173 INFO:teuthology.orchestra.run.smithi059.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 5.3 MB/s | 309 kB 00:00 2024-03-23T23:53:53.199 INFO:teuthology.orchestra.run.smithi059.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 795 kB/s | 19 kB 00:00 2024-03-23T23:53:53.299 INFO:teuthology.orchestra.run.smithi059.stdout:(108/174): lua-devel-5.4.4-4.el9.x86_64.rpm 30 kB/s | 22 kB 00:00 2024-03-23T23:53:53.407 INFO:teuthology.orchestra.run.smithi059.stdout:(109/174): libarrow-9.0.0-10.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-03-23T23:53:53.424 INFO:teuthology.orchestra.run.smithi059.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 210 kB/s | 26 kB 00:00 2024-03-23T23:53:53.449 INFO:teuthology.orchestra.run.smithi059.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-03-23T23:53:53.483 INFO:teuthology.orchestra.run.smithi059.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-23T23:53:53.508 INFO:teuthology.orchestra.run.smithi059.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-03-23T23:53:53.531 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-23T23:53:53.559 INFO:teuthology.orchestra.run.smithi059.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-03-23T23:53:53.600 INFO:teuthology.orchestra.run.smithi059.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-03-23T23:53:53.626 INFO:teuthology.orchestra.run.smithi059.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 658 kB/s | 43 kB 00:00 2024-03-23T23:53:53.676 INFO:teuthology.orchestra.run.smithi059.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 432 kB/s | 32 kB 00:00 2024-03-23T23:53:53.704 INFO:teuthology.orchestra.run.smithi059.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 195 kB/s | 15 kB 00:00 2024-03-23T23:53:53.737 INFO:teuthology.orchestra.run.smithi059.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-03-23T23:53:53.756 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-23T23:53:53.763 INFO:teuthology.orchestra.run.smithi059.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 6.1 MB/s | 358 kB 00:00 2024-03-23T23:53:53.796 INFO:teuthology.orchestra.run.smithi059.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-03-23T23:53:53.822 INFO:teuthology.orchestra.run.smithi059.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 608 kB/s | 35 kB 00:00 2024-03-23T23:53:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-23T23:53:53.856 INFO:teuthology.orchestra.run.smithi059.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-03-23T23:53:53.906 INFO:teuthology.orchestra.run.smithi059.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 2.9 MB/s | 144 kB 00:00 2024-03-23T23:53:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-23T23:53:53.973 INFO:teuthology.orchestra.run.smithi059.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-03-23T23:53:53.998 INFO:teuthology.orchestra.run.smithi059.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2024-03-23T23:53:54.015 INFO:teuthology.orchestra.run.smithi059.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 431 kB/s | 18 kB 00:00 2024-03-23T23:53:54.032 INFO:teuthology.orchestra.run.smithi059.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 707 kB/s | 23 kB 00:00 2024-03-23T23:53:54.049 INFO:teuthology.orchestra.run.smithi059.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 592 kB/s | 19 kB 00:00 2024-03-23T23:53:54.066 INFO:teuthology.orchestra.run.smithi059.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 605 kB/s | 20 kB 00:00 2024-03-23T23:53:54.125 INFO:teuthology.orchestra.run.smithi059.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-03-23T23:53:54.138 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-23T23:53:54.141 INFO:teuthology.orchestra.run.smithi059.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 621 kB/s | 46 kB 00:00 2024-03-23T23:53:54.167 INFO:teuthology.orchestra.run.smithi059.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-03-23T23:53:54.192 INFO:teuthology.orchestra.run.smithi059.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-23T23:53:54.199 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-23T23:53:54.234 INFO:teuthology.orchestra.run.smithi059.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-03-23T23:53:54.251 INFO:teuthology.orchestra.run.smithi059.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 283 kB/s | 16 kB 00:00 2024-03-23T23:53:54.281 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-23T23:53:54.285 INFO:teuthology.orchestra.run.smithi059.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-03-23T23:53:54.327 INFO:teuthology.orchestra.run.smithi059.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 378 kB/s | 28 kB 00:00 2024-03-23T23:53:54.344 INFO:teuthology.orchestra.run.smithi059.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 531 kB/s | 31 kB 00:00 2024-03-23T23:53:54.386 INFO:teuthology.orchestra.run.smithi059.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-03-23T23:53:54.401 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-23T23:53:54.411 INFO:teuthology.orchestra.run.smithi059.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 893 kB/s | 59 kB 00:00 2024-03-23T23:53:54.441 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-23T23:53:54.444 INFO:teuthology.orchestra.run.smithi059.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 619 kB/s | 36 kB 00:00 2024-03-23T23:53:54.470 INFO:teuthology.orchestra.run.smithi059.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 878 kB/s | 51 kB 00:00 2024-03-23T23:53:54.483 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-23T23:53:54.512 INFO:teuthology.orchestra.run.smithi059.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-03-23T23:53:54.537 INFO:teuthology.orchestra.run.smithi059.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-03-23T23:53:54.553 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-23T23:53:54.579 INFO:teuthology.orchestra.run.smithi059.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 6.3 MB/s | 427 kB 00:00 2024-03-23T23:53:54.597 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-23T23:53:54.604 INFO:teuthology.orchestra.run.smithi059.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 301 kB/s | 20 kB 00:00 2024-03-23T23:53:54.638 INFO:teuthology.orchestra.run.smithi059.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-03-23T23:53:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-23T23:53:54.713 INFO:teuthology.orchestra.run.smithi059.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-23T23:53:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-23T23:53:54.764 INFO:teuthology.orchestra.run.smithi059.stdout:(150/174): protobuf-compiler-3.14.0-13.el9.x86_ 399 kB/s | 863 kB 00:02 2024-03-23T23:53:54.880 INFO:teuthology.orchestra.run.smithi059.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.8 MB/s | 321 kB 00:00 2024-03-23T23:53:54.912 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-23T23:53:54.969 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-23T23:53:55.007 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-23T23:53:55.067 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-23T23:53:55.172 INFO:teuthology.orchestra.run.smithi059.stdout:(152/174): librados2-19.0.0-2145.g3be9a5c9.el9. 6.4 MB/s | 3.4 MB 00:00 2024-03-23T23:53:55.210 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-23T23:53:55.247 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-23T23:53:55.264 INFO:teuthology.orchestra.run.smithi059.stdout:(153/174): librbd1-19.0.0-2145.g3be9a5c9.el9.x8 5.7 MB/s | 3.1 MB 00:00 2024-03-23T23:53:55.292 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-23T23:53:55.329 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-23T23:53:55.362 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-23T23:53:55.535 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-23T23:53:55.556 INFO:teuthology.orchestra.run.smithi059.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 144 kB/s | 42 kB 00:00 2024-03-23T23:53:55.719 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-23T23:53:55.798 INFO:teuthology.orchestra.run.smithi059.stdout:(155/174): NetworkManager-1.47.2-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2024-03-23T23:53:55.832 INFO:teuthology.orchestra.run.smithi059.stdout:(156/174): NetworkManager-tui-1.47.2-1.el9.x86_ 904 kB/s | 248 kB 00:00 2024-03-23T23:53:55.857 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-23T23:53:55.907 INFO:teuthology.orchestra.run.smithi059.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 662 kB/s | 71 kB 00:00 2024-03-23T23:53:55.914 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-23T23:53:55.941 INFO:teuthology.orchestra.run.smithi059.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 338 kB/s | 36 kB 00:00 2024-03-23T23:53:55.977 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-23T23:53:55.999 INFO:teuthology.orchestra.run.smithi059.stdout:(159/174): NetworkManager-libnm-1.47.2-1.el9.x8 2.2 MB/s | 1.8 MB 00:00 2024-03-23T23:53:56.041 INFO:teuthology.orchestra.run.smithi059.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.4 MB/s | 192 kB 00:00 2024-03-23T23:53:56.055 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-23T23:53:56.075 INFO:teuthology.orchestra.run.smithi059.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-03-23T23:53:56.125 INFO:teuthology.orchestra.run.smithi059.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 184 kB/s | 23 kB 00:00 2024-03-23T23:53:56.150 INFO:teuthology.orchestra.run.smithi059.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-03-23T23:53:56.184 INFO:teuthology.orchestra.run.smithi059.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-03-23T23:53:56.234 INFO:teuthology.orchestra.run.smithi059.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 136 kB 00:00 2024-03-23T23:53:56.259 INFO:teuthology.orchestra.run.smithi059.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 589 kB/s | 64 kB 00:00 2024-03-23T23:53:56.285 INFO:teuthology.orchestra.run.smithi059.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 287 kB/s | 29 kB 00:00 2024-03-23T23:53:56.311 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-23T23:53:56.375 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-23T23:53:56.385 INFO:teuthology.orchestra.run.smithi059.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 8.1 MB/s | 1.2 MB 00:00 2024-03-23T23:53:56.544 INFO:teuthology.orchestra.run.smithi059.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.6 MB/s | 2.2 MB 00:00 2024-03-23T23:53:56.549 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-23T23:53:56.578 INFO:teuthology.orchestra.run.smithi059.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 2.4 MB/s | 465 kB 00:00 2024-03-23T23:53:56.600 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-23T23:53:56.653 INFO:teuthology.orchestra.run.smithi059.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.2 MB/s | 2.3 MB 00:00 2024-03-23T23:53:56.670 INFO:teuthology.orchestra.run.smithi059.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 249 kB/s | 31 kB 00:00 2024-03-23T23:53:56.670 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-23T23:53:56.709 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-23T23:53:56.750 INFO:teuthology.orchestra.run.smithi059.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.3 MB/s | 1.1 MB 00:00 2024-03-23T23:53:56.753 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-23T23:53:56.778 INFO:teuthology.orchestra.run.smithi059.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 594 kB/s | 74 kB 00:00 2024-03-23T23:53:56.787 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-03-23T23:53:56.788 INFO:teuthology.orchestra.run.smithi059.stdout:Total 15 MB/s | 224 MB 00:15 2024-03-23T23:53:56.808 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-23T23:53:56.879 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-23T23:53:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-23T23:53:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-23T23:53:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-23T23:53:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-23T23:53:57.277 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-23T23:53:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-23T23:53:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-23T23:53:57.977 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-23T23:53:58.096 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-23T23:53:58.159 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-23T23:53:58.195 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-23T23:53:58.253 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-23T23:53:58.297 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-03-23T23:53:58.387 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-23T23:53:58.452 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-23T23:53:58.697 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-03-23T23:53:58.697 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-03-23T23:53:59.465 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-23T23:53:59.534 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-23T23:53:59.569 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-23T23:53:59.628 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-23T23:53:59.742 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-23T23:53:59.785 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-23T23:54:00.029 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-23T23:54:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-23T23:54:00.199 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-23T23:54:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-23T23:54:01.121 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-03-23T23:54:01.121 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-03-23T23:54:01.198 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-23T23:54:02.804 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-23T23:54:02.901 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-23T23:54:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-23T23:54:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-23T23:54:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-23T23:54:03.455 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-23T23:54:03.483 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-23T23:54:03.612 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-23T23:54:03.639 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 125/198 2024-03-23T23:54:03.695 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-23T23:54:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-23T23:54:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-23T23:54:04.368 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-23T23:54:04.396 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 129/198 2024-03-23T23:54:07.116 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-23T23:54:07.161 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-23T23:54:07.822 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-23T23:54:07.864 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-23T23:54:08.020 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-23T23:54:08.021 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-23T23:54:08.021 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-23T23:54:08.021 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:08.064 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-23T23:54:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-03-23T23:54:08.595 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-23T23:54:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-23T23:54:08.672 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-23T23:54:08.718 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-23T23:54:08.808 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-23T23:54:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-23T23:54:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-23T23:54:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-23T23:54:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-23T23:54:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-23T23:54:09.585 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-23T23:54:09.750 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-23T23:54:09.786 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-23T23:54:09.914 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-23T23:54:09.959 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-23T23:54:10.035 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-23T23:54:10.365 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-23T23:54:10.434 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-23T23:54:10.468 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-23T23:54:10.620 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-23T23:54:10.659 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-23T23:54:10.751 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 17/198 2024-03-23T23:54:10.812 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-23T23:54:10.845 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-23T23:54:10.920 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-23T23:54:11.219 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-23T23:54:11.270 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-23T23:54:11.320 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-23T23:54:11.633 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-23T23:54:11.807 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-23T23:54:11.902 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-23T23:54:12.092 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-23T23:54:12.148 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-23T23:54:12.498 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-23T23:54:12.694 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-23T23:54:12.816 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-23T23:54:12.854 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-23T23:54:12.891 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-23T23:54:12.951 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-23T23:54:13.091 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-23T23:54:13.186 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-23T23:54:13.238 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-23T23:54:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-23T23:54:13.377 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-23T23:54:13.439 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-23T23:54:13.481 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-23T23:54:13.513 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-23T23:54:13.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-23T23:54:13.675 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 39/198 2024-03-23T23:54:13.742 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 40/198 2024-03-23T23:54:13.774 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 41/198 2024-03-23T23:54:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-23T23:54:14.050 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-23T23:54:14.175 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-23T23:54:14.393 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-23T23:54:14.455 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-23T23:54:15.177 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-23T23:54:15.274 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-23T23:54:15.473 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-23T23:54:15.812 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-23T23:54:15.859 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-23T23:54:15.926 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-23T23:54:16.033 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-23T23:54:16.097 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 53/198 2024-03-23T23:54:16.146 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-23T23:54:16.582 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-23T23:54:16.831 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-23T23:54:16.940 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-23T23:54:17.015 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-23T23:54:17.234 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-23T23:54:17.295 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-23T23:54:17.382 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-23T23:54:17.487 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-23T23:54:17.528 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-23T23:54:17.567 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-23T23:54:17.637 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-23T23:54:17.710 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-23T23:54:17.777 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-23T23:54:17.844 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-23T23:54:18.050 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-23T23:54:18.107 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-23T23:54:18.145 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-23T23:54:18.203 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-23T23:54:18.368 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-23T23:54:18.410 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-23T23:54:18.458 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-23T23:54:18.493 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-23T23:54:18.525 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-23T23:54:18.691 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-23T23:54:18.875 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-23T23:54:19.037 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-23T23:54:19.083 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-23T23:54:19.152 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-23T23:54:19.241 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-23T23:54:19.503 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-23T23:54:19.563 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-23T23:54:19.741 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-23T23:54:19.792 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-23T23:54:19.833 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-23T23:54:19.873 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-23T23:54:19.913 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-23T23:54:19.959 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-23T23:54:20.026 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-23T23:54:20.095 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-23T23:54:20.143 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-23T23:54:20.287 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-23T23:54:20.329 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-23T23:54:20.363 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-23T23:54:20.427 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-23T23:54:20.468 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-23T23:54:20.627 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-23T23:54:20.748 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-23T23:54:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-23T23:54:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-23T23:54:20.900 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-23T23:54:21.043 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-23T23:54:21.124 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-23T23:54:21.729 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-23T23:54:21.729 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2024-03-23T23:54:21.729 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2024-03-23T23:54:21.729 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2024-03-23T23:54:21.729 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2024-03-23T23:54:21.729 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2024-03-23T23:54:21.729 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /root 2024-03-23T23:54:21.730 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2024-03-23T23:54:21.730 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:21.959 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-23T23:54:22.007 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-23T23:54:22.007 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:22.007 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-23T23:54:22.007 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:22.122 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-23T23:54:22.180 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-23T23:54:22.214 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-23T23:54:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-23T23:54:22.388 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-23T23:54:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-23T23:54:22.681 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-23T23:54:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-23T23:54:22.824 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-23T23:54:23.667 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-23T23:54:23.678 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-23T23:54:23.762 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-23T23:54:23.762 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:23.762 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-23T23:54:23.762 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T23:54:23.762 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T23:54:23.763 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:23.803 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-23T23:54:24.019 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-23T23:54:24.094 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-23T23:54:24.094 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:24.094 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-23T23:54:24.094 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T23:54:24.094 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T23:54:24.094 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:24.604 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-23T23:54:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-23T23:54:24.690 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:24.690 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-23T23:54:24.690 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T23:54:24.690 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T23:54:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:24.805 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-23T23:54:25.418 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-23T23:54:25.460 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-23T23:54:25.500 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-23T23:54:25.506 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-23T23:54:25.552 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-23T23:54:25.554 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 139/198 2024-03-23T23:54:25.601 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-23T23:54:25.642 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-23T23:54:25.658 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 140/198 2024-03-23T23:54:25.695 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-23T23:54:26.036 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-23T23:54:26.046 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-23T23:54:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-23T23:54:26.080 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-23T23:54:26.215 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 124/198 2024-03-23T23:54:26.253 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 125/198 2024-03-23T23:54:26.309 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-23T23:54:26.855 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-23T23:54:26.891 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-23T23:54:26.974 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 128/198 2024-03-23T23:54:27.002 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 129/198 2024-03-23T23:54:27.254 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-23T23:54:27.288 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-23T23:54:27.436 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-23T23:54:27.618 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 144/198 2024-03-23T23:54:27.640 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-23T23:54:27.713 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-23T23:54:27.713 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-23T23:54:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T23:54:27.714 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T23:54:27.714 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:27.783 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-23T23:54:27.822 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-23T23:54:27.911 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 147/198 2024-03-23T23:54:28.950 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-23T23:54:28.993 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-23T23:54:29.079 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-23T23:54:29.079 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:29.079 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-23T23:54:29.079 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:54:29.079 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:54:29.079 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:29.152 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-23T23:54:29.249 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-23T23:54:29.249 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:29.250 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-23T23:54:29.250 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:29.336 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-23T23:54:29.441 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-23T23:54:29.442 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:29.442 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-23T23:54:29.442 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:54:29.442 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:54:29.442 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:29.731 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-23T23:54:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-23T23:54:29.836 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-23T23:54:29.918 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-23T23:54:29.919 INFO:teuthology.orchestra.run.smithi031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:29.919 INFO:teuthology.orchestra.run.smithi031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-23T23:54:29.919 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T23:54:29.919 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T23:54:29.919 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:30.427 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 130/198 2024-03-23T23:54:30.468 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-23T23:54:30.649 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 131/198 2024-03-23T23:54:30.649 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-23T23:54:30.649 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-23T23:54:30.650 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:30.693 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-23T23:54:35.027 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-23T23:54:35.081 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 154/198 2024-03-23T23:54:35.115 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 155/198 2024-03-23T23:54:35.153 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-23T23:54:35.442 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 157/198 2024-03-23T23:54:35.573 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-23T23:54:35.618 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 159/198 2024-03-23T23:54:35.682 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-23T23:54:35.733 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-23T23:54:35.777 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-23T23:54:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 163/198 2024-03-23T23:54:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-23T23:54:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-23T23:54:36.015 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-23T23:54:36.160 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-23T23:54:36.199 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-23T23:54:37.024 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-23T23:54:37.071 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-23T23:54:37.129 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-23T23:54:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 170/198 2024-03-23T23:54:38.676 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-23T23:54:38.739 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-23T23:54:38.886 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-23T23:54:38.945 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-23T23:54:38.978 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-23T23:54:39.013 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-23T23:54:39.054 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-23T23:54:39.055 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-23T23:54:39.201 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-23T23:54:39.250 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-23T23:54:39.250 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-23T23:54:39.388 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-23T23:54:39.432 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-23T23:54:39.495 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-23T23:54:39.536 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-23T23:54:39.569 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-23T23:54:39.648 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-23T23:54:39.726 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-23T23:54:39.773 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-23T23:54:39.807 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-23T23:54:39.841 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-23T23:54:39.873 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-23T23:54:39.898 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-23T23:54:39.935 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-23T23:54:39.935 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-23T23:54:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-23T23:54:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-23T23:54:40.397 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-23T23:54:40.430 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-23T23:54:40.483 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-23T23:54:40.516 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-23T23:54:40.553 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-23T23:54:40.677 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-23T23:54:40.947 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-23T23:54:40.948 INFO:teuthology.orchestra.run.smithi031.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-23T23:54:40.948 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:44.166 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 132/198 2024-03-23T23:54:44.166 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-03-23T23:54:44.166 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-03-23T23:54:44.166 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-03-23T23:54:44.166 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-03-23T23:54:44.166 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-03-23T23:54:44.166 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-03-23T23:54:44.167 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-03-23T23:54:44.167 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:44.398 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-23T23:54:44.448 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 133/198 2024-03-23T23:54:44.448 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:44.448 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-23T23:54:44.449 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:45.779 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 1/198 2024-03-23T23:54:45.779 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2/198 2024-03-23T23:54:45.779 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 3/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 4/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 5/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 6/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 7/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 8/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 9/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 13/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 14/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 15/198 2024-03-23T23:54:45.780 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 17/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 18/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 19/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 20/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 21/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 22/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 23/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 24/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 25/198 2024-03-23T23:54:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 26/198 2024-03-23T23:54:45.782 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 27/198 2024-03-23T23:54:45.801 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 28/198 2024-03-23T23:54:45.801 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 29/198 2024-03-23T23:54:45.801 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 30/198 2024-03-23T23:54:45.801 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 31/198 2024-03-23T23:54:45.801 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 32/198 2024-03-23T23:54:45.801 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 33/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 34/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 35/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 36/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 37/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 38/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 39/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-23T23:54:45.802 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-23T23:54:45.803 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-23T23:54:45.805 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-23T23:54:45.806 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-23T23:54:45.807 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-23T23:54:45.808 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-23T23:54:45.809 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-23T23:54:45.810 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-23T23:54:45.811 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-23T23:54:45.812 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-23T23:54:45.813 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-23T23:54:45.814 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-23T23:54:45.815 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-23T23:54:45.816 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-23T23:54:45.816 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-23T23:54:45.816 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-23T23:54:45.816 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-23T23:54:45.816 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-23T23:54:45.816 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-23T23:54:45.816 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-23T23:54:46.125 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-23T23:54:46.207 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 134/198 2024-03-23T23:54:46.207 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:46.207 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-23T23:54:46.207 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T23:54:46.208 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T23:54:46.208 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:46.466 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-23T23:54:46.536 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 135/198 2024-03-23T23:54:46.536 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:46.536 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-23T23:54:46.536 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T23:54:46.536 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T23:54:46.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:47.051 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-23T23:54:47.121 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 136/198 2024-03-23T23:54:47.121 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:47.121 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-23T23:54:47.122 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T23:54:47.122 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T23:54:47.122 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:47.261 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-23T23:54:47.891 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-23T23:54:48.029 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 138/198 2024-03-23T23:54:48.094 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 139/198 2024-03-23T23:54:48.216 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 140/198 2024-03-23T23:54:48.249 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-23T23:54:48.383 INFO:teuthology.orchestra.run.smithi031.stdout: acl-2.3.1-4.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-23T23:54:48.384 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.2-8.el9.noarch 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.7.4-5.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.385 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.386 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.4-9.el9.x86_64 2024-03-23T23:54:48.387 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.6-16.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.388 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-23T23:54:48.389 INFO:teuthology.orchestra.run.smithi031.stdout: lua-5.4.4-4.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-13.11-1.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-23T23:54:48.390 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-23T23:54:48.391 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-23T23:54:48.392 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ply-3.11-14.el9.noarch 2024-03-23T23:54:48.393 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-23T23:54:48.394 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-23T23:54:48.395 INFO:teuthology.orchestra.run.smithi031.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: re2-1:20211101-3.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-23T23:54:48.396 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-23T23:54:48.397 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-23T23:54:48.397 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:54:48.397 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2024-03-23T23:54:48.599 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 141/198 2024-03-23T23:54:48.641 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-23T23:54:49.032 DEBUG:teuthology.parallel:result is None 2024-03-23T23:54:49.823 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 142/198 2024-03-23T23:54:49.868 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-23T23:54:50.021 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 143/198 2024-03-23T23:54:50.206 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 144/198 2024-03-23T23:54:50.236 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-23T23:54:50.329 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 145/198 2024-03-23T23:54:50.329 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:50.329 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-23T23:54:50.329 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T23:54:50.329 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T23:54:50.329 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:50.386 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-23T23:54:50.426 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 146/198 2024-03-23T23:54:50.527 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 147/198 2024-03-23T23:54:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-23T23:54:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-23T23:54:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 149/198 2024-03-23T23:54:51.670 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:51.670 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-23T23:54:51.670 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:54:51.670 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T23:54:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-23T23:54:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 150/198 2024-03-23T23:54:51.788 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:51.788 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-23T23:54:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-23T23:54:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-23T23:54:51.953 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:51.953 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-23T23:54:51.953 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:54:51.953 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T23:54:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-23T23:54:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 152/198 2024-03-23T23:54:52.434 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T23:54:52.434 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-23T23:54:52.435 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T23:54:52.435 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T23:54:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:54:57.513 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-23T23:54:57.565 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 154/198 2024-03-23T23:54:57.610 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 155/198 2024-03-23T23:54:57.649 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-23T23:54:57.991 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 157/198 2024-03-23T23:54:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-23T23:54:58.180 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 159/198 2024-03-23T23:54:58.244 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-23T23:54:58.321 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-23T23:54:58.374 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-23T23:54:58.448 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 163/198 2024-03-23T23:54:58.463 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-23T23:54:58.515 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-23T23:54:58.613 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-23T23:54:58.716 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-23T23:54:58.747 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-23T23:54:59.692 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-23T23:54:59.744 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-23T23:54:59.800 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-23T23:55:01.231 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 170/198 2024-03-23T23:55:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-23T23:55:01.398 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-23T23:55:01.534 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-23T23:55:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-23T23:55:01.609 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-23T23:55:01.643 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-23T23:55:01.686 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-23T23:55:01.686 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-23T23:55:01.857 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-23T23:55:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-23T23:55:01.906 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-23T23:55:02.044 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-23T23:55:02.089 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-23T23:55:02.143 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-23T23:55:02.185 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-23T23:55:02.217 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-23T23:55:02.288 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-23T23:55:02.365 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-23T23:55:02.439 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-23T23:55:02.474 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-23T23:55:02.505 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-23T23:55:02.538 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-23T23:55:02.571 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-23T23:55:02.610 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-23T23:55:02.611 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-23T23:55:02.921 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-23T23:55:02.927 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-23T23:55:03.061 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-23T23:55:03.091 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-23T23:55:03.155 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-23T23:55:03.194 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-23T23:55:03.235 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-23T23:55:03.357 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-23T23:55:03.627 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-23T23:55:03.627 INFO:teuthology.orchestra.run.smithi059.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-23T23:55:03.627 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 1/198 2024-03-23T23:55:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2/198 2024-03-23T23:55:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 3/198 2024-03-23T23:55:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 4/198 2024-03-23T23:55:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2145.g3be9a 5/198 2024-03-23T23:55:08.436 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 6/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 7/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 8/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 9/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 10/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 11/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 12/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 13/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 14/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_ 15/198 2024-03-23T23:55:08.437 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 16/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 17/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_6 18/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86 19/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 20/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el 21/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9. 22/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_6 23/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 24/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 25/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 26/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 27/198 2024-03-23T23:55:08.438 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 28/198 2024-03-23T23:55:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 29/198 2024-03-23T23:55:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9. 30/198 2024-03-23T23:55:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noa 31/198 2024-03-23T23:55:08.455 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.n 32/198 2024-03-23T23:55:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be 33/198 2024-03-23T23:55:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el 34/198 2024-03-23T23:55:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 35/198 2024-03-23T23:55:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.e 36/198 2024-03-23T23:55:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 37/198 2024-03-23T23:55:08.456 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 38/198 2024-03-23T23:55:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 39/198 2024-03-23T23:55:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-23T23:55:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-23T23:55:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-23T23:55:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-23T23:55:08.457 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-23T23:55:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-23T23:55:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-23T23:55:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-23T23:55:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-23T23:55:08.458 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-23T23:55:08.459 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-23T23:55:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-23T23:55:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-23T23:55:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-23T23:55:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-23T23:55:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-23T23:55:08.460 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-23T23:55:08.461 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-23T23:55:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-23T23:55:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-23T23:55:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-23T23:55:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-23T23:55:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-23T23:55:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-23T23:55:08.462 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-23T23:55:08.463 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-23T23:55:08.464 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-23T23:55:08.465 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-23T23:55:08.466 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-23T23:55:08.467 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-23T23:55:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-23T23:55:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-23T23:55:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-23T23:55:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-23T23:55:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-23T23:55:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-23T23:55:08.468 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-23T23:55:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-23T23:55:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-23T23:55:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-23T23:55:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-23T23:55:08.469 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-23T23:55:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-23T23:55:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-23T23:55:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 151/198 2024-03-23T23:55:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-23T23:55:08.470 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 153/198 2024-03-23T23:55:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-23T23:55:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-23T23:55:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-23T23:55:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-23T23:55:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-23T23:55:08.471 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-23T23:55:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-23T23:55:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-23T23:55:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-23T23:55:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-23T23:55:08.472 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-23T23:55:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-23T23:55:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-23T23:55:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-23T23:55:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-23T23:55:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-23T23:55:08.473 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-23T23:55:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-23T23:55:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-23T23:55:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-23T23:55:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-23T23:55:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-23T23:55:08.474 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-23T23:55:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-23T23:55:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-23T23:55:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-23T23:55:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-23T23:55:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-23T23:55:08.475 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-23T23:55:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-23T23:55:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-23T23:55:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-23T23:55:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-23T23:55:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-23T23:55:08.476 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-23T23:55:08.477 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-23T23:55:08.478 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-23T23:55:10.942 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-23T23:55:10.942 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:10.942 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-03-23T23:55:10.942 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: acl-2.3.1-4.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.943 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-23T23:55:10.944 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.945 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.946 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:19.0.0-2145.g3be9a5c9.el9.noarch 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.6-16.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-23T23:55:10.947 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.948 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-23T23:55:10.949 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.11-1.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.950 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-23T23:55:10.951 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-23T23:55:10.952 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-23T23:55:10.953 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-23T23:55:10.954 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.955 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.0.0-2145.g3be9a5c9.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-3.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:10.956 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-03-23T23:55:11.641 DEBUG:teuthology.parallel:result is None 2024-03-23T23:55:11.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:55:11.790 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-23T23:55:11.866 INFO:teuthology.orchestra.run.smithi031.stdout:19.0.0-2145.g3be9a5c9.el9 2024-03-23T23:55:11.866 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2145.g3be9a5c9.el9 2024-03-23T23:55:11.867 INFO:teuthology.task.install:The correct ceph version 19.0.0-2145.g3be9a5c9 is installed. 2024-03-23T23:55:11.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:55:12.084 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-23T23:55:12.150 INFO:teuthology.orchestra.run.smithi059.stdout:19.0.0-2145.g3be9a5c9.el9 2024-03-23T23:55:12.150 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2145.g3be9a5c9.el9 2024-03-23T23:55:12.150 INFO:teuthology.task.install:The correct ceph version 19.0.0-2145.g3be9a5c9 is installed. 2024-03-23T23:55:12.152 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-23T23:55:12.152 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:12.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-23T23:55:12.260 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:12.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-23T23:55:12.341 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-23T23:55:12.341 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:12.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-03-23T23:55:12.442 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-23T23:55:12.579 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:12.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-03-23T23:55:12.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-23T23:55:12.773 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-23T23:55:12.774 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:12.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-23T23:55:12.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-23T23:55:12.985 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:12.986 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-23T23:55:13.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-23T23:55:13.179 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-23T23:55:13.179 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:13.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-03-23T23:55:13.268 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-23T23:55:13.353 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:13.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-03-23T23:55:13.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-23T23:55:13.532 INFO:teuthology.run_tasks:Running task ceph... 2024-03-23T23:55:13.618 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-23T23:55:13.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-03-23T23:55:13.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-03-23T23:55:13.712 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-23T23:55:13.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-23T23:55:13.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-23T23:55:13.798 INFO:tasks.ceph:Creating extra log directories... 2024-03-23T23:55:13.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-23T23:55:13.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-23T23:55:13.893 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-23T23:55:13.893 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-23T23:55:13.893 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-23T23:55:13.893 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:13.893 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-23T23:55:13.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:14.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:14.311 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:14.312 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-23T23:55:14.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:14.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:14.636 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-23T23:55:14.636 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-23T23:55:14.636 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414', 'branch': 'wip-mchangir-testing-main-20240318.032620', 'description': 'fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7616414', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-main-20240318.032620'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-main-20240318.032620', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}}, 'owner': 'mchangir', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 3550, 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'sleep_before_teardown': 0, 'subset': '613/1024', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-main-20240318.032620', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4lwNX5QNvT+pyLOZV5EIjD1xOiWfDXLXOaViQ6vqUR514pjgAXowOqHA9uB83z9/u0NNnRcdYmfBwQWWSuaiA=', 'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwSqqx5Cmv0r6+LNQpDN2JYWJ+7vWjx9kOmMGrUozalGrHbQGtQzNhDMsWkK0qDLABIubMln60gk+mcLAf8qfU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5ec3e6e88b2e2783e09498588bb1f433ae9c8986'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3be9a5c9bc793e11e2800a8c0c696e8b46742033', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['client/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-22_09:49:57', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-23T23:55:14.637 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-23T23:55:14.644 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-23T23:55:14.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-03-23T23:55:14.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2024-03-23T23:55:14.802 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:14.802 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-03-23T23:55:14.864 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-23T23:55:14.864 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-03-23T23:55:14.916 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-23T23:55:14.916 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:14.917 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 639 Links: 1 2024-03-23T23:55:14.917 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:14.917 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:14.917 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-03-23 23:54:41.393672362 +0000 2024-03-23T23:55:14.917 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-03-23 23:52:01.474174279 +0000 2024-03-23T23:55:14.917 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-03-23 23:52:01.474174279 +0000 2024-03-23T23:55:14.917 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-03-23 23:52:01.474174279 +0000 2024-03-23T23:55:14.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-23T23:55:15.006 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-03-23T23:55:15.007 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-03-23T23:55:15.007 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000319103 s, 1.6 MB/s 2024-03-23T23:55:15.011 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-23T23:55:15.068 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-03-23T23:55:15.122 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-23T23:55:15.122 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:15.122 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 657 Links: 1 2024-03-23T23:55:15.122 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:15.122 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:15.122 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-03-23 23:54:41.394672345 +0000 2024-03-23T23:55:15.123 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-03-23 23:52:02.051164694 +0000 2024-03-23T23:55:15.123 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-03-23 23:52:02.051164694 +0000 2024-03-23T23:55:15.123 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-03-23 23:52:02.051164694 +0000 2024-03-23T23:55:15.123 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-23T23:55:15.209 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-03-23T23:55:15.209 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-03-23T23:55:15.209 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000342435 s, 1.5 MB/s 2024-03-23T23:55:15.212 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-23T23:55:15.265 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-03-23T23:55:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 678 Links: 1 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-03-23 23:54:41.394672345 +0000 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-03-23 23:52:02.709153764 +0000 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-03-23 23:52:02.709153764 +0000 2024-03-23T23:55:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-03-23 23:52:02.709153764 +0000 2024-03-23T23:55:15.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-23T23:55:15.411 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-03-23T23:55:15.411 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-03-23T23:55:15.411 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.00033239 s, 1.5 MB/s 2024-03-23T23:55:15.415 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-23T23:55:15.475 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-03-23T23:55:15.525 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-23T23:55:15.525 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:15.525 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 697 Links: 1 2024-03-23T23:55:15.525 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:15.525 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:15.525 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-03-23 23:54:41.395672329 +0000 2024-03-23T23:55:15.526 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-03-23 23:52:03.320143615 +0000 2024-03-23T23:55:15.526 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-03-23 23:52:03.320143615 +0000 2024-03-23T23:55:15.526 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-03-23 23:52:03.320143615 +0000 2024-03-23T23:55:15.526 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-23T23:55:15.618 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-03-23T23:55:15.618 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-03-23T23:55:15.618 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000348117 s, 1.5 MB/s 2024-03-23T23:55:15.622 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-23T23:55:15.684 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:15.684 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:15.684 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-03-23T23:55:15.734 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-23T23:55:15.735 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-03-23T23:55:15.818 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-23T23:55:15.818 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:15.818 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-03-23T23:55:15.818 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:15.818 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:15.818 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-23 23:55:04.093705202 +0000 2024-03-23T23:55:15.818 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-23 23:51:51.138542002 +0000 2024-03-23T23:55:15.819 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-23 23:51:51.138542002 +0000 2024-03-23T23:55:15.819 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-23 23:51:51.138542002 +0000 2024-03-23T23:55:15.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-23T23:55:15.927 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-23T23:55:15.927 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-23T23:55:15.927 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000412602 s, 1.2 MB/s 2024-03-23T23:55:15.930 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-23T23:55:15.973 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-23 23:55:04.093705202 +0000 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-23 23:51:51.700534283 +0000 2024-03-23T23:55:16.051 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-23 23:51:51.701534269 +0000 2024-03-23T23:55:16.052 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-23 23:51:51.700534283 +0000 2024-03-23T23:55:16.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-23T23:55:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-23T23:55:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-23T23:55:16.154 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000261453 s, 2.0 MB/s 2024-03-23T23:55:16.156 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-23T23:55:16.195 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-03-23T23:55:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-23T23:55:16.274 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:16.274 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-23T23:55:16.274 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:16.274 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:16.274 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-23 23:55:04.095705175 +0000 2024-03-23T23:55:16.274 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-23 23:51:52.284526262 +0000 2024-03-23T23:55:16.275 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-23 23:51:52.284526262 +0000 2024-03-23T23:55:16.275 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-23 23:51:52.284526262 +0000 2024-03-23T23:55:16.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-23T23:55:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-23T23:55:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-23T23:55:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000340892 s, 1.5 MB/s 2024-03-23T23:55:16.411 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-23T23:55:16.471 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-03-23 23:55:04.095705175 +0000 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-03-23 23:51:52.892517911 +0000 2024-03-23T23:55:16.523 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-03-23 23:51:52.892517911 +0000 2024-03-23T23:55:16.524 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-03-23 23:51:52.892517911 +0000 2024-03-23T23:55:16.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-23T23:55:16.616 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-03-23T23:55:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-03-23T23:55:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000359673 s, 1.4 MB/s 2024-03-23T23:55:16.621 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-23T23:55:16.678 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:16.678 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-23T23:55:16.678 INFO:tasks.ceph:Generating config... 2024-03-23T23:55:16.679 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-23T23:55:16.679 INFO:tasks.ceph:[client] debug client = 20 2024-03-23T23:55:16.680 INFO:tasks.ceph:[client] debug ms = 1 2024-03-23T23:55:16.680 INFO:tasks.ceph:[client] pid file = 2024-03-23T23:55:16.680 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-23T23:55:16.680 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-23T23:55:16.680 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-23T23:55:16.681 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-23T23:55:16.681 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-23T23:55:16.681 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-23T23:55:16.681 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-23T23:55:16.681 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-23T23:55:16.681 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-23T23:55:16.681 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-23T23:55:16.682 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-23T23:55:16.682 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-23T23:55:16.682 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-23T23:55:16.682 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-23T23:55:16.682 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-23T23:55:16.682 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-23T23:55:16.682 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-23T23:55:16.682 INFO:tasks.ceph:Setting up mon.a... 2024-03-23T23:55:16.682 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-23T23:55:16.834 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-03-23T23:55:16.845 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-23T23:55:16.987 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T23:55:17.087 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.59'), ('mon.c', '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]')] 2024-03-23T23:55:17.087 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-23T23:55:17.088 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:17.088 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-23T23:55:17.145 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.59 --addv c '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:17.257 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:17.257 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid 6654f0f5-f55e-4e42-bb02-030326afa81f 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:fsid 6654f0f5-f55e-4e42-bb02-030326afa81f 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-03-23T23:55:17.258726+0000 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-03-23T23:55:17.258726+0000 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 17 (quincy) 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] mon.c 2024-03-23T23:55:17.258 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-23T23:55:17.261 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-23T23:55:17.315 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6654f0f5-f55e-4e42-bb02-030326afa81f... 2024-03-23T23:55:17.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-23T23:55:17.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-23T23:55:17.489 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.490 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-03-23T23:55:17.491 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-03-23T23:55:17.492 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 6654f0f5-f55e-4e42-bb02-030326afa81f 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-03-23T23:55:17.493 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-03-23T23:55:17.494 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2024-03-23T23:55:17.495 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.496 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-03-23T23:55:17.497 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-23T23:55:17.498 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-03-23T23:55:17.499 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-03-23T23:55:17.500 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-03-23T23:55:17.501 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-03-23T23:55:17.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-03-23T23:55:17.503 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-03-23T23:55:17.504 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.31,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 6654f0f5-f55e-4e42-bb02-030326afa81f 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.505 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.506 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = bitmap 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 1/20 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 1/20 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-03-23T23:55:17.507 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 4/10 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:55:17.508 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.509 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-03-23T23:55:17.510 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-03-23T23:55:17.511 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-03-23T23:55:17.513 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-03-23T23:55:17.514 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-03-23T23:55:17.514 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2024-03-23T23:55:17.514 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-03-23T23:55:17.514 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2024-03-23T23:55:17.514 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-03-23T23:55:17.514 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-03-23T23:55:17.514 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-03-23T23:55:17.570 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-23T23:55:17.570 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-23T23:55:17.730 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-23T23:55:17.730 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:17.730 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-23T23:55:17.788 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:17.788 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-23T23:55:17.839 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:55:17.839 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:17.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-23T23:55:17.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T23:55:17.994 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:17.994 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:18.093 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:55:18.093 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:18.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-23T23:55:18.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T23:55:18.259 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:18.260 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:18.358 INFO:tasks.ceph:Setting up mon nodes... 2024-03-23T23:55:18.358 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-23T23:55:18.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-23T23:55:18.552 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-23T23:55:18.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-23T23:55:18.772 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-23T23:55:18.785 INFO:tasks.ceph:Setting up mds nodes... 2024-03-23T23:55:18.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-23T23:55:18.978 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-23T23:55:18.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-23T23:55:19.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-23T23:55:19.279 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-23T23:55:19.289 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-23T23:55:19.392 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-23T23:55:19.393 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-23T23:55:19.525 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-23T23:55:19.578 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-23T23:55:19.578 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-23T23:55:19.578 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-23T23:55:19.683 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:19.683 INFO:tasks.ceph:role: osd.0 2024-03-23T23:55:19.683 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:55:19.683 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:19.789 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:19.790 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:19.790 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:20.299 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-03-23T23:55:20.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-03-23T23:55:20.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-23T23:55:20.508 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-23T23:55:20.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-23T23:55:20.726 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:20.726 INFO:tasks.ceph:role: osd.1 2024-03-23T23:55:20.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:55:20.726 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:20.830 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:20.831 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:20.831 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:21.322 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-03-23T23:55:21.329 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-03-23T23:55:21.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-23T23:55:21.494 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-23T23:55:21.593 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-23T23:55:21.693 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:21.693 INFO:tasks.ceph:role: osd.2 2024-03-23T23:55:21.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:55:21.693 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-23T23:55:21.797 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:21.797 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:21.797 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:21.797 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:21.798 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:21.798 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:21.798 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:21.798 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:21.798 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:21.798 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:22.303 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-03-23T23:55:22.311 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-03-23T23:55:22.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-23T23:55:22.514 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-23T23:55:22.633 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-23T23:55:22.736 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:22.736 INFO:tasks.ceph:role: osd.3 2024-03-23T23:55:22.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:55:22.736 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-23T23:55:22.851 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:22.851 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:22.852 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:23.329 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-03-23T23:55:23.337 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-03-23T23:55:23.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-23T23:55:23.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-23T23:55:23.587 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:23.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:23.745+0000 7fa833c13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-23T23:55:23.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:23.751+0000 7fa833c13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-23T23:55:23.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:23.751+0000 7fa833c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T23:55:23.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:23.751+0000 7fa833c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T23:55:23.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:23.751+0000 7fa833c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T23:55:23.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:23.762+0000 7fa833c13640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-23T23:55:26.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-23T23:55:26.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:26.964+0000 7f3c3412a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-23T23:55:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:26.964+0000 7f3c3412a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-23T23:55:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:26.965+0000 7f3c3412a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T23:55:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:26.965+0000 7f3c3412a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T23:55:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:26.965+0000 7f3c3412a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T23:55:26.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:26.967+0000 7f3c3412a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-23T23:55:29.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-23T23:55:30.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:30.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:30.149+0000 7f511aea6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-23T23:55:30.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:30.149+0000 7f511aea6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-23T23:55:30.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:30.149+0000 7f511aea6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T23:55:30.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:30.149+0000 7f511aea6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T23:55:30.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:30.149+0000 7f511aea6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T23:55:30.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:30.152+0000 7f511aea6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-23T23:55:33.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-23T23:55:33.431 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:33.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:33.579+0000 7fc27aca8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-23T23:55:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:33.580+0000 7fc27aca8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-23T23:55:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:33.580+0000 7fc27aca8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T23:55:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:33.580+0000 7fc27aca8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T23:55:33.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:33.580+0000 7fc27aca8640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T23:55:33.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:33.582+0000 7fc27aca8640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-23T23:55:36.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-23T23:55:36.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-23T23:55:36.968 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:36.968 INFO:tasks.ceph:role: osd.4 2024-03-23T23:55:36.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:55:36.968 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-23T23:55:37.075 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:37.075 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:37.075 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:37.076 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:37.076 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:37.076 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:37.076 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:37.076 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:37.076 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:37.076 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:37.599 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-03-23T23:55:37.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-03-23T23:55:37.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-23T23:55:37.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-23T23:55:37.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-23T23:55:37.992 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:37.992 INFO:tasks.ceph:role: osd.5 2024-03-23T23:55:37.992 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:55:37.993 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-23T23:55:38.081 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:38.082 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:38.082 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:38.082 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:38.082 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:38.550 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-03-23T23:55:38.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-03-23T23:55:38.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-23T23:55:38.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-23T23:55:38.768 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-23T23:55:38.852 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:38.852 INFO:tasks.ceph:role: osd.6 2024-03-23T23:55:38.852 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:55:38.853 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:38.938 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:39.448 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-03-23T23:55:39.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-03-23T23:55:39.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-23T23:55:39.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-23T23:55:39.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-23T23:55:39.835 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T23:55:39.835 INFO:tasks.ceph:role: osd.7 2024-03-23T23:55:39.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:55:39.835 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-23T23:55:39.938 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T23:55:39.938 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T23:55:39.938 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T23:55:39.939 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T23:55:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T23:55:39.939 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-03-23T23:55:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T23:55:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T23:55:39.939 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T23:55:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T23:55:40.395 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-03-23T23:55:40.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-03-23T23:55:40.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-23T23:55:40.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-23T23:55:40.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:40.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:40.811+0000 7fab70d1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-23T23:55:40.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:40.814+0000 7fab70d1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-23T23:55:40.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:40.814+0000 7fab70d1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T23:55:40.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:40.814+0000 7fab70d1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T23:55:40.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:40.814+0000 7fab70d1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T23:55:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:40.824+0000 7fab70d1b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-23T23:55:44.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-23T23:55:44.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:44.275+0000 7fae3320d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-23T23:55:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:44.276+0000 7fae3320d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-23T23:55:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:44.276+0000 7fae3320d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T23:55:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:44.276+0000 7fae3320d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T23:55:44.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:44.276+0000 7fae3320d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T23:55:44.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:44.278+0000 7fae3320d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-23T23:55:44.638 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:44.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:55:47.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-23T23:55:47.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:47.473+0000 7fbf1baae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-23T23:55:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:47.474+0000 7fbf1baae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-23T23:55:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:47.474+0000 7fbf1baae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T23:55:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:47.474+0000 7fbf1baae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T23:55:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:47.474+0000 7fbf1baae640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T23:55:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:47.476+0000 7fbf1baae640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-23T23:55:50.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-23T23:55:50.525 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:50.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:50.675+0000 7f2c306a0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-23T23:55:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:50.676+0000 7f2c306a0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-23T23:55:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:50.676+0000 7f2c306a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T23:55:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:50.676+0000 7f2c306a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T23:55:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:50.676+0000 7f2c306a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T23:55:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:55:50.678+0000 7f2c306a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-23T23:55:53.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-23T23:55:53.971 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-23T23:55:53.972 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:53.972 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-23T23:55:54.075 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:54.075 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-23T23:55:54.175 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:54.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-23T23:55:54.276 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:54.276 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-23T23:55:54.376 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:54.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-23T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:54.473 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-23T23:55:54.575 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:54.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-23T23:55:54.682 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:54.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-23T23:55:54.780 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:54.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-23T23:55:54.876 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:54.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-23T23:55:54.972 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:54.973 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-23T23:55:55.075 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:55:55.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-23T23:55:55.172 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:55:55.172 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-23T23:55:55.231 INFO:tasks.ceph:Adding keys to all mons... 2024-03-23T23:55:55.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-23T23:55:55.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-23T23:55:55.326 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDma/9lgQwEIRAAXiRaZy8xusIWYOtx/3V4aA== 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDma/9lB61rOhAAACpoUmlQGjy+5MThDejKqA== 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDra/9lXxaDLBAAbldEFciEy8v5fXyQV/JAng== 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDua/9l5zKMORAAyV3QutU25myHTw5ZiMdAHQ== 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDya/9l0NvzCBAAkScdEVMZmmPjk/gsTdtmQg== 2024-03-23T23:55:55.327 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQD1a/9lDp6cIhAAOOg5qm5ljvU9q2ZwjhM+lA== 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDma/9lLZIgLhAAcq2s3PIG0sL3HSQEWHR8Ug== 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDna/9lBNW5EBAAjxrfswlcy6RZTxAZfoEEkw== 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQD8a/9l/e5iMBAA+D06rbPFs2RCjlgFbj1Kvw== 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQAAbP9lTDJ1EBAARcCDqpRUe9dBP9B2X1l1xQ== 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQADbP9lTaBHHBAA7AJ1X4BMC7n2YAKpDoRp8Q== 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2024-03-23T23:55:55.328 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQAGbP9l54VJKBAAD8lZx0/Yk9KRsD4NgmUAFQ== 2024-03-23T23:55:55.329 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-03-23T23:55:55.329 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQDna/9lxPhmHxAAbOg3FxlgXuV5ZGFKuwQSlg== 2024-03-23T23:55:55.337 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2024-03-23T23:55:55.337 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDma/9lgQwEIRAAXiRaZy8xusIWYOtx/3V4aA== 2024-03-23T23:55:55.338 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-03-23T23:55:55.338 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDma/9lB61rOhAAACpoUmlQGjy+5MThDejKqA== 2024-03-23T23:55:55.338 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-03-23T23:55:55.338 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDra/9lXxaDLBAAbldEFciEy8v5fXyQV/JAng== 2024-03-23T23:55:55.338 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDua/9l5zKMORAAyV3QutU25myHTw5ZiMdAHQ== 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDya/9l0NvzCBAAkScdEVMZmmPjk/gsTdtmQg== 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD1a/9lDp6cIhAAOOg5qm5ljvU9q2ZwjhM+lA== 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDma/9lLZIgLhAAcq2s3PIG0sL3HSQEWHR8Ug== 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDna/9lBNW5EBAAjxrfswlcy6RZTxAZfoEEkw== 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD8a/9l/e5iMBAA+D06rbPFs2RCjlgFbj1Kvw== 2024-03-23T23:55:55.339 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2024-03-23T23:55:55.340 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAAbP9lTDJ1EBAARcCDqpRUe9dBP9B2X1l1xQ== 2024-03-23T23:55:55.340 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2024-03-23T23:55:55.340 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQADbP9lTaBHHBAA7AJ1X4BMC7n2YAKpDoRp8Q== 2024-03-23T23:55:55.340 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2024-03-23T23:55:55.340 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAGbP9l54VJKBAAD8lZx0/Yk9KRsD4NgmUAFQ== 2024-03-23T23:55:55.340 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-03-23T23:55:55.340 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDna/9lxPhmHxAAbOg3FxlgXuV5ZGFKuwQSlg== 2024-03-23T23:55:55.343 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:55:55.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:55:55.534 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:55:55.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:55:55.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:55.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:55.851 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:55.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.015 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:55:56.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T23:55:56.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:55:56.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T23:55:56.630 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.635 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.944 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:56.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:57.096 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:57.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T23:55:57.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T23:55:57.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T23:55:57.417 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-23T23:55:57.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-23T23:55:57.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T23:55:57.688 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-23T23:55:57.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-23T23:55:57.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T23:55:58.055 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-23T23:55:58.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-23T23:55:58.258 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T23:55:58.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-23T23:55:58.502 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:58.510 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-23T23:55:58.562 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-23T23:55:58.563 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T23:55:58.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T23:55:58.568 INFO:tasks.ceph.mon.a:Started 2024-03-23T23:55:58.568 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T23:55:58.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T23:55:58.573 INFO:tasks.ceph.mon.b:Started 2024-03-23T23:55:58.573 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T23:55:58.573 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T23:55:58.577 INFO:tasks.ceph.mon.c:Started 2024-03-23T23:55:58.577 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-23T23:55:58.577 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-23T23:55:58.578 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-23T23:55:58.582 INFO:tasks.ceph.mgr.y:Started 2024-03-23T23:55:58.582 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-23T23:55:58.583 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-23T23:55:58.587 INFO:tasks.ceph.mgr.x:Started 2024-03-23T23:55:58.587 INFO:tasks.ceph:Setting crush tunables to default 2024-03-23T23:55:58.587 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-03-23T23:55:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.769+0000 7f1649600640 1 Processor -- start 2024-03-23T23:55:58.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.769+0000 7f1649600640 1 -- start start 2024-03-23T23:55:58.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.770+0000 7f1649600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:55:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.770+0000 7f1649600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16440b26d0 con 0x7f16440b3f40 2024-03-23T23:55:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f1649600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1644070400 con 0x7f16440b45d0 2024-03-23T23:55:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f1649600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16440b43d0 con 0x7f16440b22f0 2024-03-23T23:55:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f163a000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f16440b45d0 0x7f164413f0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:55370/0 (socket says 172.21.15.31:55370) 2024-03-23T23:55:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 learned_addr learned my addr 172.21.15.31:0/707142459 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:55:58.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.771+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:58.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.772+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:55:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.973+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.974+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.974+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.974+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:58.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:58.974+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:55:59.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:59.375+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:55:59.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:59.376+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:55:59.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:59.376+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:55:59.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:59.376+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:55:59.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:55:59.376+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:56:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:00.178+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:00.178+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:56:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:00.178+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:00.178+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:00.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:00.178+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:56:01.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 msgr2=0x7f1644148710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:01.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b22f0 0x7f1644148710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:01.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 >> v1:172.21.15.59:6789/0 conn(0x7f16440b45d0 legacy=0x7f164413f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:01.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 >> v1:172.21.15.31:6789/0 conn(0x7f16440b3f40 legacy=0x7f164414faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:01.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:01.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:01.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1620008d10 con 0x7f16200061c0 2024-03-23T23:56:01.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1620008ec0 con 0x7f16200036f0 2024-03-23T23:56:01.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:01.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.771+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:01.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.772+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.973+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.973+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.973+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.973+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.973+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.974+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.974+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.974+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.974+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:56:01.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:01.974+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.375+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.375+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:02.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:56:02.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:02.376+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T23:56:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.177+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T23:56:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T23:56:03.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f163a000640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f1642a00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T23:56:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T23:56:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f1642a00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:56:03.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:03.178+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T23:56:04.664 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:04.663+0000 7f2e3543a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-23T23:56:04.733 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:04.733+0000 7f2e3543a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-23T23:56:04.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:04.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 msgr2=0x7f1620008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:04.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f1620008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1643400640 1 -- 172.21.15.31:0/707142459 reap_dead start 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f162000c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16440b4c90 con 0x7f16440b3f40 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1620008d10 con 0x7f16200061c0 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1640c00640 1 -- 172.21.15.31:0/707142459 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1620008ec0 con 0x7f16200036f0 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.771+0000 7f1643400640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.31:3300/0 conn(0x7f16200061c0 0x7f162000c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.772+0000 7f163a000640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.772+0000 7f1643400640 1 -- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 msgr2=0x7f1620005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.772+0000 7f1643400640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.772+0000 7f1643400640 1 -- 172.21.15.31:0/707142459 >> v1:172.21.15.31:6789/0 conn(0x7f16440b3f40 legacy=0x7f162000b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.772+0000 7f1643400640 1 -- 172.21.15.31:0/707142459 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200087c0 con 0x7f16200061c0 2024-03-23T23:56:04.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.772+0000 7f1642000640 1 -- 172.21.15.31:0/707142459 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387256070 0 0) 0x7f16440b4c90 con 0x7f16440b3f40 2024-03-23T23:56:04.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.773+0000 7f1643400640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200061c0 0x7f162000c9e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f164406cfc0 tx=0x7f163c02b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8c485935968982 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:04.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.774+0000 7f1642000640 1 -- 172.21.15.31:0/707142459 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c007330 con 0x7f16200061c0 2024-03-23T23:56:04.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.774+0000 7f1642000640 1 -- 172.21.15.31:0/707142459 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c0074d0 con 0x7f16200061c0 2024-03-23T23:56:04.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.774+0000 7f1642000640 1 -- 172.21.15.31:0/707142459 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c005a00 con 0x7f16200061c0 2024-03-23T23:56:04.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 -- 172.21.15.31:0/707142459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200061c0 msgr2=0x7f162000c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:04.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200061c0 0x7f162000c9e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f164406cfc0 tx=0x7f163c02b590 comp rx=0 tx=0).stop 2024-03-23T23:56:04.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 -- 172.21.15.31:0/707142459 shutdown_connections 2024-03-23T23:56:04.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 --2- 172.21.15.31:0/707142459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200061c0 0x7f162000c9e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 --2- 172.21.15.31:0/707142459 >> v2:172.21.15.59:3300/0 conn(0x7f16200036f0 0x7f1620005b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 -- 172.21.15.31:0/707142459 >> 172.21.15.31:0/707142459 conn(0x7f16440b8d60 msgr2=0x7f16440b9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:04.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 -- 172.21.15.31:0/707142459 shutdown_connections 2024-03-23T23:56:04.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.775+0000 7f1649600640 1 -- 172.21.15.31:0/707142459 wait complete. 2024-03-23T23:56:04.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.777+0000 7f1649600640 1 Processor -- start 2024-03-23T23:56:04.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.777+0000 7f1649600640 1 -- start start 2024-03-23T23:56:04.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1649600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200036f0 0x7f1644141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1649600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16200061c0 0x7f1644070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1649600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b3f40 0x7f1644071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1649600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16440b4f70 con 0x7f16200036f0 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1649600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16440b4a50 con 0x7f16200061c0 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1649600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1644070120 con 0x7f16440b3f40 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1642a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200036f0 0x7f1644141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1642a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200036f0 0x7f1644141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37842/0 (socket says 172.21.15.31:37842) 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.778+0000 7f1642a00640 1 -- 172.21.15.31:0/2799603805 learned_addr learned my addr 172.21.15.31:0/2799603805 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f163a000640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16200061c0 0x7f1644070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f1643400640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b3f40 0x7f1644071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f1642a00640 1 -- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b3f40 msgr2=0x7f1644071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f1642a00640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b3f40 0x7f1644071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f1642a00640 1 -- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16200061c0 msgr2=0x7f1644070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f1642a00640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16200061c0 0x7f1644070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f1642a00640 1 -- 172.21.15.31:0/2799603805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16441428d0 con 0x7f16200036f0 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f1642a00640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200036f0 0x7f1644141900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f163400ad60 tx=0x7f1634018790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.779+0000 7f163b400640 1 -- 172.21.15.31:0/2799603805 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634019840 con 0x7f16200036f0 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.780+0000 7f163b400640 1 -- 172.21.15.31:0/2799603805 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1634019a00 con 0x7f16200036f0 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.780+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1644140740 con 0x7f16200036f0 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.780+0000 7f163b400640 1 -- 172.21.15.31:0/2799603805 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634019df0 con 0x7f16200036f0 2024-03-23T23:56:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.780+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1644072550 con 0x7f16200036f0 2024-03-23T23:56:04.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.780+0000 7f163b400640 1 -- 172.21.15.31:0/2799603805 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1634015040 con 0x7f16200036f0 2024-03-23T23:56:04.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.780+0000 7f163b400640 1 -- 172.21.15.31:0/2799603805 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f163402dac0 con 0x7f16200036f0 2024-03-23T23:56:04.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.781+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164404f400 con 0x7f16200036f0 2024-03-23T23:56:04.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.785+0000 7f163b400640 1 -- 172.21.15.31:0/2799603805 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1634010040 con 0x7f16200036f0 2024-03-23T23:56:04.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.860+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f164406fb60 con 0x7f16200036f0 2024-03-23T23:56:04.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.865+0000 7f163b400640 1 -- 172.21.15.31:0/2799603805 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f163402dd10 con 0x7f16200036f0 2024-03-23T23:56:04.865 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-03-23T23:56:04.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.866+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200036f0 msgr2=0x7f1644141900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:04.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.866+0000 7f1649600640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200036f0 0x7f1644141900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f163400ad60 tx=0x7f1634018790 comp rx=0 tx=0).stop 2024-03-23T23:56:04.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.866+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 shutdown_connections 2024-03-23T23:56:04.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.866+0000 7f1649600640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16200061c0 0x7f1644070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.866+0000 7f1649600640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16440b3f40 0x7f1644071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.866+0000 7f1649600640 1 --2- 172.21.15.31:0/2799603805 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16200036f0 0x7f1644141900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:04.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.866+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 >> 172.21.15.31:0/2799603805 conn(0x7f16440b8d60 msgr2=0x7f164413cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:04.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.867+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 shutdown_connections 2024-03-23T23:56:04.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:04.867+0000 7f1649600640 1 -- 172.21.15.31:0/2799603805 wait complete. 2024-03-23T23:56:04.884 INFO:tasks.ceph:check_enable_crimson: False 2024-03-23T23:56:04.884 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-23T23:56:04.884 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:56:04.884 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-23T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:56:04.966 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-23T23:56:05.100 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:56:05.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-23T23:56:05.187 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:56:05.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-23T23:56:05.279 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:56:05.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-23T23:56:05.330 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:05.330+0000 7f338201a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-23T23:56:05.371 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.370+0000 7f2e3543a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-23T23:56:05.375 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:56:05.375 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-23T23:56:05.395 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:05.395+0000 7f338201a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-23T23:56:05.439 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.439+0000 7f2e3543a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-23T23:56:05.470 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:56:05.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-23T23:56:05.494 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.493+0000 7f2e3543a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-23T23:56:05.560 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-03-23T23:56:05.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-23T23:56:05.561 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.560+0000 7f2e3543a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-23T23:56:05.614 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.613+0000 7f2e3543a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-23T23:56:05.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 464a7c55-2a06-40ea-8482-78177113a61f 0 2024-03-23T23:56:05.753 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.752+0000 7f2e3543a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-23T23:56:05.840 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.839+0000 7f2e3543a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-23T23:56:05.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.875+0000 7f28e1e00640 1 Processor -- start 2024-03-23T23:56:05.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.876+0000 7f28e1e00640 1 -- start start 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28e1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28dc0b57f0 0x7f28dc0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28e1e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28dc0b4fc0 0x7f28dc151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28e1e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc072630 con 0x7f28dc06d3f0 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28e1e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc141a30 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28e1e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc06d7d0 con 0x7f28dc0b57f0 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28dc0b57f0 0x7f28dc0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28dc0b57f0 0x7f28dc0b4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50400/0 (socket says 172.21.15.59:50400) 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28d3e00640 1 -- 172.21.15.59:0/1307495535 learned_addr learned my addr 172.21.15.59:0/1307495535 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28daa00640 1 --1- 172.21.15.59:0/1307495535 >> v1:172.21.15.59:6789/0 conn(0x7f28dc06d3f0 0x7f28dc141320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42646/0 (socket says 172.21.15.59:42646) 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28d3e00640 1 -- 172.21.15.59:0/1307495535 >> v2:172.21.15.31:3300/0 conn(0x7f28dc0b4fc0 msgr2=0x7f28dc151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28d3e00640 1 --2- 172.21.15.59:0/1307495535 >> v2:172.21.15.31:3300/0 conn(0x7f28dc0b4fc0 0x7f28dc151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28d3e00640 1 -- 172.21.15.59:0/1307495535 >> v1:172.21.15.59:6789/0 conn(0x7f28dc06d3f0 legacy=0x7f28dc141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.877+0000 7f28d3e00640 1 -- 172.21.15.59:0/1307495535 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc071e30 con 0x7f28dc0b57f0 2024-03-23T23:56:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.878+0000 7f28d3e00640 1 --2- 172.21.15.59:0/1307495535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc0b4a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28dc06de40 tx=0x7f28c402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eda9826a70bff834 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.879+0000 7f28da000640 1 -- 172.21.15.59:0/1307495535 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4034070 con 0x7f28dc0b57f0 2024-03-23T23:56:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.879+0000 7f28da000640 1 -- 172.21.15.59:0/1307495535 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4030860 con 0x7f28dc0b57f0 2024-03-23T23:56:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.879+0000 7f28da000640 1 -- 172.21.15.59:0/1307495535 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4030c30 con 0x7f28dc0b57f0 2024-03-23T23:56:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.879+0000 7f28e1e00640 1 -- 172.21.15.59:0/1307495535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 msgr2=0x7f28dc0b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.879+0000 7f28e1e00640 1 --2- 172.21.15.59:0/1307495535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc0b4a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f28dc06de40 tx=0x7f28c402b9a0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.880+0000 7f28e1e00640 1 -- 172.21.15.59:0/1307495535 shutdown_connections 2024-03-23T23:56:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.880+0000 7f28e1e00640 1 --2- 172.21.15.59:0/1307495535 >> v2:172.21.15.31:3300/0 conn(0x7f28dc0b4fc0 0x7f28dc151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.880+0000 7f28e1e00640 1 --2- 172.21.15.59:0/1307495535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc0b4a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.880+0000 7f28e1e00640 1 -- 172.21.15.59:0/1307495535 >> 172.21.15.59:0/1307495535 conn(0x7f28dc0b9b60 msgr2=0x7f28dc0b9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.880+0000 7f28e1e00640 1 -- 172.21.15.59:0/1307495535 shutdown_connections 2024-03-23T23:56:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.880+0000 7f28e1e00640 1 -- 172.21.15.59:0/1307495535 wait complete. 2024-03-23T23:56:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.881+0000 7f28e1e00640 1 Processor -- start 2024-03-23T23:56:05.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.881+0000 7f28e1e00640 1 -- start start 2024-03-23T23:56:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28dc06d3f0 0x7f28dc142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28dc0b4fc0 0x7f28dc1dd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28e1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc1dd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:05.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28e1e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc070460 con 0x7f28dc06d3f0 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28e1e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc071ac0 con 0x7f28dc0b57f0 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28e1e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0705e0 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28db400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc1dd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28d3e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28dc0b4fc0 0x7f28dc1dd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28d3e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28dc0b4fc0 0x7f28dc1dd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45196/0 (socket says 172.21.15.59:45196) 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28db400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc1dd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50416/0 (socket says 172.21.15.59:50416) 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.882+0000 7f28d3e00640 1 -- 172.21.15.59:0/3132342018 learned_addr learned my addr 172.21.15.59:0/3132342018 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28daa00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28dc06d3f0 0x7f28dc142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28d3e00640 1 -- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 msgr2=0x7f28dc1dd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28d3e00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc1dd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28d3e00640 1 -- 172.21.15.59:0/3132342018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28dc06d3f0 msgr2=0x7f28dc142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28d3e00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28dc06d3f0 0x7f28dc142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28d3e00640 1 -- 172.21.15.59:0/3132342018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc144530 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28db400640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc1dd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28d3e00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28dc0b4fc0 0x7f28dc1dd040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28c402b9e0 tx=0x7f28c40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.883+0000 7f28d3400640 1 -- 172.21.15.59:0/3132342018 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4034040 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.884+0000 7f28d3400640 1 -- 172.21.15.59:0/3132342018 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c40433f0 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.884+0000 7f28d3400640 1 -- 172.21.15.59:0/3132342018 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40437e0 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.884+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc0adfe0 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.884+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc1441c0 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.884+0000 7f28d3400640 1 -- 172.21.15.59:0/3132342018 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f28c4037070 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.884+0000 7f28d3400640 1 -- 172.21.15.59:0/3132342018 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f28c404c620 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.885+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc04f400 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.890+0000 7f28d3400640 1 -- 172.21.15.59:0/3132342018 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f28c403e070 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.900 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.900+0000 7f2e3543a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-23T23:56:05.964 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:05.964+0000 7f2e3543a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-23T23:56:05.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.970+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "464a7c55-2a06-40ea-8482-78177113a61f", "id": 0} v 0) v1 -- 0x7f28dc0add00 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.976+0000 7f28d3400640 1 -- 172.21.15.59:0/3132342018 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "464a7c55-2a06-40ea-8482-78177113a61f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28c4030720 con 0x7f28dc0b4fc0 2024-03-23T23:56:05.977 INFO:teuthology.orchestra.run.smithi059.stdout:0 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28dc0b4fc0 msgr2=0x7f28dc1dd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28dc0b4fc0 0x7f28dc1dd040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28c402b9e0 tx=0x7f28c40046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 shutdown_connections 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28dc0b57f0 0x7f28dc1dd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28dc0b4fc0 0x7f28dc1dd040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 --2- 172.21.15.59:0/3132342018 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28dc06d3f0 0x7f28dc142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 >> 172.21.15.59:0/3132342018 conn(0x7f28dc0b9b60 msgr2=0x7f28dc0b63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 shutdown_connections 2024-03-23T23:56:05.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:05.978+0000 7f28e1e00640 1 -- 172.21.15.59:0/3132342018 wait complete. 2024-03-23T23:56:05.996 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new f7a68ffa-141e-4319-9dcf-0135ccb438a3 1 2024-03-23T23:56:06.012 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.013+0000 7f338201a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-23T23:56:06.026 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:06.025+0000 7f2e3543a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-23T23:56:06.081 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.081+0000 7f338201a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-23T23:56:06.134 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.134+0000 7f338201a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-23T23:56:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.178+0000 7fde7f200640 1 Processor -- start 2024-03-23T23:56:06.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.178+0000 7fde7f200640 1 -- start start 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7f200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde800b50a0 0x7fde80147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b9810 0x7fde80141340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde800b9330 con 0x7fde800b6b50 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7f200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde80147660 con 0x7fde800b50a0 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde80141880 con 0x7fde800b9810 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fde800b6b50 0x7fde80140c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42648/0 (socket says 172.21.15.59:42648) 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7d400640 1 -- 172.21.15.59:0/4092868669 learned_addr learned my addr 172.21.15.59:0/4092868669 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7e800640 1 --2- 172.21.15.59:0/4092868669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b9810 0x7fde80141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.180+0000 7fde7de00640 1 --2- 172.21.15.59:0/4092868669 >> v2:172.21.15.31:3300/0 conn(0x7fde800b50a0 0x7fde80147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.181+0000 7fde7ca00640 1 -- 172.21.15.59:0/4092868669 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801750500 0 0) 0x7fde800b9330 con 0x7fde800b6b50 2024-03-23T23:56:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.181+0000 7fde7ca00640 1 -- 172.21.15.59:0/4092868669 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde64003520 con 0x7fde800b6b50 2024-03-23T23:56:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.181+0000 7fde7e800640 1 -- 172.21.15.59:0/4092868669 >> v2:172.21.15.31:3300/0 conn(0x7fde800b50a0 msgr2=0x7fde80147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:06.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.181+0000 7fde7e800640 1 --2- 172.21.15.59:0/4092868669 >> v2:172.21.15.31:3300/0 conn(0x7fde800b50a0 0x7fde80147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.181+0000 7fde7e800640 1 -- 172.21.15.59:0/4092868669 >> v1:172.21.15.59:6789/0 conn(0x7fde800b6b50 legacy=0x7fde80140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.181+0000 7fde7e800640 1 -- 172.21.15.59:0/4092868669 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800b5480 con 0x7fde800b9810 2024-03-23T23:56:06.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.182+0000 7fde7e800640 1 --2- 172.21.15.59:0/4092868669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b9810 0x7fde80141340 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde78009d90 tx=0x7fde7802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=707286919bf91625 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.182+0000 7fde7ca00640 1 -- 172.21.15.59:0/4092868669 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78039070 con 0x7fde800b9810 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.182+0000 7fde7ca00640 1 -- 172.21.15.59:0/4092868669 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7802cbd0 con 0x7fde800b9810 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.182+0000 7fde7ca00640 1 -- 172.21.15.59:0/4092868669 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78034440 con 0x7fde800b9810 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 -- 172.21.15.59:0/4092868669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b9810 msgr2=0x7fde80141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 --2- 172.21.15.59:0/4092868669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b9810 0x7fde80141340 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fde78009d90 tx=0x7fde7802be20 comp rx=0 tx=0).stop 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 -- 172.21.15.59:0/4092868669 shutdown_connections 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 --2- 172.21.15.59:0/4092868669 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b9810 0x7fde80141340 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 --2- 172.21.15.59:0/4092868669 >> v2:172.21.15.31:3300/0 conn(0x7fde800b50a0 0x7fde80147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 -- 172.21.15.59:0/4092868669 >> 172.21.15.59:0/4092868669 conn(0x7fde80066dd0 msgr2=0x7fde800671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:06.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 -- 172.21.15.59:0/4092868669 shutdown_connections 2024-03-23T23:56:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.183+0000 7fde7f200640 1 -- 172.21.15.59:0/4092868669 wait complete. 2024-03-23T23:56:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.185+0000 7fde7f200640 1 Processor -- start 2024-03-23T23:56:06.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.185+0000 7fde7f200640 1 -- start start 2024-03-23T23:56:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800b50a0 0x7fde8013b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b6b50 0x7fde801dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde800b9810 0x7fde80135c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde800b4000 con 0x7fde800b9810 2024-03-23T23:56:06.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde800b63e0 con 0x7fde800b50a0 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde800b42e0 con 0x7fde800b6b50 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800b50a0 0x7fde8013b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7d400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b6b50 0x7fde801dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800b50a0 0x7fde8013b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50418/0 (socket says 172.21.15.59:50418) 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7de00640 1 -- 172.21.15.59:0/112666759 learned_addr learned my addr 172.21.15.59:0/112666759 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.186+0000 7fde7e800640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde800b9810 0x7fde80135c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7de00640 1 -- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b6b50 msgr2=0x7fde801dffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7de00640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b6b50 0x7fde801dffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7de00640 1 -- 172.21.15.59:0/112666759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde800b9810 msgr2=0x7fde80135c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7de00640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde800b9810 0x7fde80135c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7de00640 1 -- 172.21.15.59:0/112666759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800bc370 con 0x7fde800b50a0 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7d400640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b6b50 0x7fde801dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:06.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7e800640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde800b9810 0x7fde80135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7de00640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800b50a0 0x7fde8013b540 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde7000e9b0 tx=0x7fde7000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:06.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde76000640 1 -- 172.21.15.59:0/112666759 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70017070 con 0x7fde800b50a0 2024-03-23T23:56:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde76000640 1 -- 172.21.15.59:0/112666759 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000c9a0 con 0x7fde800b50a0 2024-03-23T23:56:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde76000640 1 -- 172.21.15.59:0/112666759 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000cd90 con 0x7fde800b50a0 2024-03-23T23:56:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde800bacf0 con 0x7fde800b50a0 2024-03-23T23:56:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.187+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde80138a00 con 0x7fde800b50a0 2024-03-23T23:56:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.188+0000 7fde76000640 1 -- 172.21.15.59:0/112666759 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fde7001a070 con 0x7fde800b50a0 2024-03-23T23:56:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.188+0000 7fde76000640 1 -- 172.21.15.59:0/112666759 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fde7001c980 con 0x7fde800b50a0 2024-03-23T23:56:06.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.188+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde800689d0 con 0x7fde800b50a0 2024-03-23T23:56:06.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.191+0000 7fde76000640 1 -- 172.21.15.59:0/112666759 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fde800689d0 con 0x7fde800b50a0 2024-03-23T23:56:06.200 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.200+0000 7f338201a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-23T23:56:06.252 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.252+0000 7f338201a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-23T23:56:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.270+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7a68ffa-141e-4319-9dcf-0135ccb438a3", "id": 1} v 0) v1 -- 0x7fde800752c0 con 0x7fde800b50a0 2024-03-23T23:56:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.277+0000 7fde76000640 1 -- 172.21.15.59:0/112666759 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7a68ffa-141e-4319-9dcf-0135ccb438a3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde7001ccb0 con 0x7fde800b50a0 2024-03-23T23:56:06.277 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800b50a0 msgr2=0x7fde8013b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800b50a0 0x7fde8013b540 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde7000e9b0 tx=0x7fde7000ee70 comp rx=0 tx=0).stop 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 shutdown_connections 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde800b9810 0x7fde80135c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde800b6b50 0x7fde801dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 --2- 172.21.15.59:0/112666759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde800b50a0 0x7fde8013b540 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 >> 172.21.15.59:0/112666759 conn(0x7fde80066dd0 msgr2=0x7fde8013f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 shutdown_connections 2024-03-23T23:56:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.278+0000 7fde7f200640 1 -- 172.21.15.59:0/112666759 wait complete. 2024-03-23T23:56:06.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 0393bb76-6fe9-44fd-aa19-e1431efaab12 2 2024-03-23T23:56:06.389 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.389+0000 7f338201a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-23T23:56:06.473 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.473+0000 7f338201a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-23T23:56:06.517 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:06.516+0000 7f2e3543a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-23T23:56:06.530 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.528+0000 7f338201a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-23T23:56:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.532+0000 7f2b89000640 1 Processor -- start 2024-03-23T23:56:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.532+0000 7f2b89000640 1 -- start start 2024-03-23T23:56:06.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.533+0000 7f2b89000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b84141200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b89000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b840b4de0 0x7f2b84147410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b89000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b840b5290 con 0x7f2b84141740 2024-03-23T23:56:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b89000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b840b9f70 con 0x7f2b840b4de0 2024-03-23T23:56:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b89000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840b5530 con 0x7f2b840b9b90 2024-03-23T23:56:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b84141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b84141200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45210/0 (socket says 172.21.15.59:45210) 2024-03-23T23:56:06.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81e00640 1 -- 172.21.15.59:0/2341708778 learned_addr learned my addr 172.21.15.59:0/2341708778 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b82800640 1 --1- 172.21.15.59:0/2341708778 >> v1:172.21.15.59:6789/0 conn(0x7f2b84141740 0x7f2b8414a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42664/0 (socket says 172.21.15.59:42664) 2024-03-23T23:56:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81400640 1 --2- 172.21.15.59:0/2341708778 >> v2:172.21.15.31:3300/0 conn(0x7f2b840b4de0 0x7f2b84147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81e00640 1 -- 172.21.15.59:0/2341708778 >> v2:172.21.15.31:3300/0 conn(0x7f2b840b4de0 msgr2=0x7f2b84147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81e00640 1 --2- 172.21.15.59:0/2341708778 >> v2:172.21.15.31:3300/0 conn(0x7f2b840b4de0 0x7f2b84147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81e00640 1 -- 172.21.15.59:0/2341708778 >> v1:172.21.15.59:6789/0 conn(0x7f2b84141740 legacy=0x7f2b8414a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b81e00640 1 -- 172.21.15.59:0/2341708778 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b840b9170 con 0x7f2b840b9b90 2024-03-23T23:56:06.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.534+0000 7f2b80a00640 1 -- 172.21.15.59:0/2341708778 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365367681 0 0) 0x7f2b840b5290 con 0x7f2b84141740 2024-03-23T23:56:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.536+0000 7f2b81e00640 1 --2- 172.21.15.59:0/2341708778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b84141200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009870 tx=0x7f2b7402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=688d56068be57c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.536+0000 7f2b80a00640 1 -- 172.21.15.59:0/2341708778 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74034070 con 0x7f2b840b9b90 2024-03-23T23:56:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.536+0000 7f2b80a00640 1 -- 172.21.15.59:0/2341708778 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b74030840 con 0x7f2b840b9b90 2024-03-23T23:56:06.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.536+0000 7f2b80a00640 1 -- 172.21.15.59:0/2341708778 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b74030c10 con 0x7f2b840b9b90 2024-03-23T23:56:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.536+0000 7f2b89000640 1 -- 172.21.15.59:0/2341708778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 msgr2=0x7f2b84141200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.536+0000 7f2b89000640 1 --2- 172.21.15.59:0/2341708778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b84141200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2b74009870 tx=0x7f2b7402b980 comp rx=0 tx=0).stop 2024-03-23T23:56:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.537+0000 7f2b89000640 1 -- 172.21.15.59:0/2341708778 shutdown_connections 2024-03-23T23:56:06.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.537+0000 7f2b89000640 1 --2- 172.21.15.59:0/2341708778 >> v2:172.21.15.31:3300/0 conn(0x7f2b840b4de0 0x7f2b84147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.537+0000 7f2b89000640 1 --2- 172.21.15.59:0/2341708778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b84141200 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.537+0000 7f2b89000640 1 -- 172.21.15.59:0/2341708778 >> 172.21.15.59:0/2341708778 conn(0x7f2b84067010 msgr2=0x7f2b84067420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.537+0000 7f2b89000640 1 -- 172.21.15.59:0/2341708778 shutdown_connections 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.537+0000 7f2b89000640 1 -- 172.21.15.59:0/2341708778 wait complete. 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.538+0000 7f2b89000640 1 Processor -- start 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.538+0000 7f2b89000640 1 -- start start 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.539+0000 7f2b89000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b8414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.539+0000 7f2b89000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84141740 0x7f2b841dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.539+0000 7f2b89000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b84149e90 0x7f2b84137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.539+0000 7f2b89000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840b6f30 con 0x7f2b84141740 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.539+0000 7f2b89000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b840b6db0 con 0x7f2b84149e90 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.539+0000 7f2b89000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84147950 con 0x7f2b840b9b90 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.539+0000 7f2b81e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b8414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b82800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b84149e90 0x7f2b84137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b81e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b8414ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45220/0 (socket says 172.21.15.59:45220) 2024-03-23T23:56:06.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b81e00640 1 -- 172.21.15.59:0/2381887994 learned_addr learned my addr 172.21.15.59:0/2381887994 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b81400640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84141740 0x7f2b841dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b82800640 1 -- 172.21.15.59:0/2381887994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 msgr2=0x7f2b8414ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b82800640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b8414ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b82800640 1 -- 172.21.15.59:0/2381887994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84141740 msgr2=0x7f2b841dd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b82800640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84141740 0x7f2b841dd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b82800640 1 -- 172.21.15.59:0/2381887994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84149570 con 0x7f2b84149e90 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.540+0000 7f2b82800640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b84149e90 0x7f2b84137c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2b84141bd0 tx=0x7f2b7c00cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.541+0000 7f2b7a000640 1 -- 172.21.15.59:0/2381887994 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c018070 con 0x7f2b84149e90 2024-03-23T23:56:06.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.541+0000 7f2b7a000640 1 -- 172.21.15.59:0/2381887994 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c004d60 con 0x7f2b84149e90 2024-03-23T23:56:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.541+0000 7f2b7a000640 1 -- 172.21.15.59:0/2381887994 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c00a880 con 0x7f2b84149e90 2024-03-23T23:56:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.541+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b84148810 con 0x7f2b84149e90 2024-03-23T23:56:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.541+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b841ddd30 con 0x7f2b84149e90 2024-03-23T23:56:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.541+0000 7f2b7a000640 1 -- 172.21.15.59:0/2381887994 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2b7c01b070 con 0x7f2b84149e90 2024-03-23T23:56:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.541+0000 7f2b7a000640 1 -- 172.21.15.59:0/2381887994 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2b7c0070d0 con 0x7f2b84149e90 2024-03-23T23:56:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.542+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b841dd0c0 con 0x7f2b84149e90 2024-03-23T23:56:06.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.544+0000 7f2b7a000640 1 -- 172.21.15.59:0/2381887994 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2b7c007670 con 0x7f2b84149e90 2024-03-23T23:56:06.592 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.592+0000 7f338201a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-23T23:56:06.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.624+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0393bb76-6fe9-44fd-aa19-e1431efaab12", "id": 2} v 0) v1 -- 0x7f2b84149740 con 0x7f2b84149e90 2024-03-23T23:56:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.631+0000 7f2b7a000640 1 -- 172.21.15.59:0/2381887994 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0393bb76-6fe9-44fd-aa19-e1431efaab12", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b84149740 con 0x7f2b84149e90 2024-03-23T23:56:06.632 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b84149e90 msgr2=0x7f2b84137c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b84149e90 0x7f2b84137c20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2b84141bd0 tx=0x7f2b7c00cbe0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 shutdown_connections 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b84149e90 0x7f2b84137c20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b84141740 0x7f2b841dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 --2- 172.21.15.59:0/2381887994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b840b9b90 0x7f2b8414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 >> 172.21.15.59:0/2381887994 conn(0x7f2b84067010 msgr2=0x7f2b840b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 shutdown_connections 2024-03-23T23:56:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.633+0000 7f2b89000640 1 -- 172.21.15.59:0/2381887994 wait complete. 2024-03-23T23:56:06.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 9202a8ae-0c87-417d-99c4-33bfd8521be8 3 2024-03-23T23:56:06.650 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:06.650+0000 7f338201a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-23T23:56:06.691 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:06.690+0000 7f2e3543a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-23T23:56:06.829 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:06.828+0000 7f2e3543a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-23T23:56:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.842+0000 7f7c1c600640 1 Processor -- start 2024-03-23T23:56:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.842+0000 7f7c1c600640 1 -- start start 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.843+0000 7f7c1c600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c140b9b90 0x7f7c14141200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1c600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7c140b4de0 0x7f7c14147410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1c600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14141740 0x7f7c14147950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1c600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140b5290 con 0x7f7c140b4de0 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1c600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c140b9f70 con 0x7f7c140b9b90 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1c600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b5530 con 0x7f7c14141740 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c19c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c140b9b90 0x7f7c14141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1a600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14141740 0x7f7c14147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c19c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c140b9b90 0x7f7c14141200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50424/0 (socket says 172.21.15.59:50424) 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c19c00640 1 -- 172.21.15.59:0/1805016914 learned_addr learned my addr 172.21.15.59:0/1805016914 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c19200640 1 --2- 172.21.15.59:0/1805016914 >> v2:172.21.15.31:3300/0 conn(0x7f7c140b4de0 0x7f7c14147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1a600640 1 -- 172.21.15.59:0/1805016914 >> v2:172.21.15.59:3300/0 conn(0x7f7c140b9b90 msgr2=0x7f7c14141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1a600640 1 --2- 172.21.15.59:0/1805016914 >> v2:172.21.15.59:3300/0 conn(0x7f7c140b9b90 0x7f7c14141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1a600640 1 -- 172.21.15.59:0/1805016914 >> v2:172.21.15.31:3300/0 conn(0x7f7c140b4de0 msgr2=0x7f7c14147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1a600640 1 --2- 172.21.15.59:0/1805016914 >> v2:172.21.15.31:3300/0 conn(0x7f7c140b4de0 0x7f7c14147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c1a600640 1 -- 172.21.15.59:0/1805016914 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140b9170 con 0x7f7c14141740 2024-03-23T23:56:06.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.844+0000 7f7c19c00640 1 --2- 172.21.15.59:0/1805016914 >> v2:172.21.15.59:3300/0 conn(0x7f7c140b9b90 0x7f7c14141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.845+0000 7f7c1a600640 1 --2- 172.21.15.59:0/1805016914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14141740 0x7f7c14147950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ba2c0 tx=0x7f7c0c02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98818e1ae12d4cc8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.846+0000 7f7c13e00640 1 -- 172.21.15.59:0/1805016914 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c039070 con 0x7f7c14141740 2024-03-23T23:56:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.846+0000 7f7c13e00640 1 -- 172.21.15.59:0/1805016914 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c02cbd0 con 0x7f7c14141740 2024-03-23T23:56:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.846+0000 7f7c13e00640 1 -- 172.21.15.59:0/1805016914 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c034440 con 0x7f7c14141740 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 -- 172.21.15.59:0/1805016914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14141740 msgr2=0x7f7c14147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 --2- 172.21.15.59:0/1805016914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14141740 0x7f7c14147950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ba2c0 tx=0x7f7c0c02be20 comp rx=0 tx=0).stop 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 -- 172.21.15.59:0/1805016914 shutdown_connections 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 --2- 172.21.15.59:0/1805016914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14141740 0x7f7c14147950 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 --2- 172.21.15.59:0/1805016914 >> v2:172.21.15.31:3300/0 conn(0x7f7c140b4de0 0x7f7c14147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 --2- 172.21.15.59:0/1805016914 >> v2:172.21.15.59:3300/0 conn(0x7f7c140b9b90 0x7f7c14141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 -- 172.21.15.59:0/1805016914 >> 172.21.15.59:0/1805016914 conn(0x7f7c14067010 msgr2=0x7f7c14067420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 -- 172.21.15.59:0/1805016914 shutdown_connections 2024-03-23T23:56:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.847+0000 7f7c1c600640 1 -- 172.21.15.59:0/1805016914 wait complete. 2024-03-23T23:56:06.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.848+0000 7f7c1c600640 1 Processor -- start 2024-03-23T23:56:06.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c1c600640 1 -- start start 2024-03-23T23:56:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c1c600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c140b9b90 0x7f7c14142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c1c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c14141740 0x7f7c14141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c1c600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14147e50 0x7f7c141e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c1c600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b6f30 con 0x7f7c140b9b90 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c1c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140b6db0 con 0x7f7c14141740 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c1c600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1414a900 con 0x7f7c14147e50 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.849+0000 7f7c19200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c14141740 0x7f7c14141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c14141740 0x7f7c14141c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50438/0 (socket says 172.21.15.59:50438) 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 -- 172.21.15.59:0/3347489015 learned_addr learned my addr 172.21.15.59:0/3347489015 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c1a600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14147e50 0x7f7c141e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19c00640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c140b9b90 0x7f7c14142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 -- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14147e50 msgr2=0x7f7c141e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14147e50 0x7f7c141e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 -- 172.21.15.59:0/3347489015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c140b9b90 msgr2=0x7f7c14142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c140b9b90 0x7f7c14142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 -- 172.21.15.59:0/3347489015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14144120 con 0x7f7c14141740 2024-03-23T23:56:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c1a600640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14147e50 0x7f7c141e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.850+0000 7f7c19200640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c14141740 0x7f7c14141c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000d830 tx=0x7f7c0000dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:06.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.851+0000 7f7c11600640 1 -- 172.21.15.59:0/3347489015 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000b660 con 0x7f7c14141740 2024-03-23T23:56:06.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.851+0000 7f7c11600640 1 -- 172.21.15.59:0/3347489015 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00019070 con 0x7f7c14141740 2024-03-23T23:56:06.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.851+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c14144a30 con 0x7f7c14141740 2024-03-23T23:56:06.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.851+0000 7f7c11600640 1 -- 172.21.15.59:0/3347489015 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000ba20 con 0x7f7c14141740 2024-03-23T23:56:06.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.851+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c14144390 con 0x7f7c14141740 2024-03-23T23:56:06.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.851+0000 7f7c11600640 1 -- 172.21.15.59:0/3347489015 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7c0001e460 con 0x7f7c14141740 2024-03-23T23:56:06.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.851+0000 7f7c11600640 1 -- 172.21.15.59:0/3347489015 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7c0000bdd0 con 0x7f7c14141740 2024-03-23T23:56:06.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.852+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1404f400 con 0x7f7c14141740 2024-03-23T23:56:06.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.854+0000 7f7c11600640 1 -- 172.21.15.59:0/3347489015 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7c00014700 con 0x7f7c14141740 2024-03-23T23:56:06.888 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:06.887+0000 7f2e3543a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-23T23:56:06.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.934+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9202a8ae-0c87-417d-99c4-33bfd8521be8", "id": 3} v 0) v1 -- 0x7f7c1413db40 con 0x7f7c14141740 2024-03-23T23:56:07.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.940+0000 7f7c11600640 1 -- 172.21.15.59:0/3347489015 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9202a8ae-0c87-417d-99c4-33bfd8521be8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7c00014ab0 con 0x7f7c14141740 2024-03-23T23:56:07.055 INFO:teuthology.orchestra.run.smithi059.stdout:3 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.942+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c14141740 msgr2=0x7f7c14141c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.942+0000 7f7c1c600640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c14141740 0x7f7c14141c00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000d830 tx=0x7f7c0000dcf0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.943+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 shutdown_connections 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.943+0000 7f7c1c600640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c14141740 0x7f7c14141c00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.943+0000 7f7c1c600640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c14147e50 0x7f7c141e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.943+0000 7f7c1c600640 1 --2- 172.21.15.59:0/3347489015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7c140b9b90 0x7f7c14142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.943+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 >> 172.21.15.59:0/3347489015 conn(0x7f7c14067010 msgr2=0x7f7c14140200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.943+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 shutdown_connections 2024-03-23T23:56:07.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:06.943+0000 7f7c1c600640 1 -- 172.21.15.59:0/3347489015 wait complete. 2024-03-23T23:56:07.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new ac629292-9951-4570-866a-fd09ad372056 4 2024-03-23T23:56:07.058 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:07.022+0000 7f2e3543a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:56:07.124 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.124+0000 7f338201a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-23T23:56:07.143 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:07.141+0000 7f2e3543a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-23T23:56:07.292 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.292+0000 7f338201a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-23T23:56:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.309+0000 7fa389200640 1 Processor -- start 2024-03-23T23:56:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.309+0000 7fa389200640 1 -- start start 2024-03-23T23:56:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa389200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa384141340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa389200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3840b9810 0x7fa384147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa389200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3840b9330 con 0x7fa3840b50a0 2024-03-23T23:56:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa389200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa384141880 con 0x7fa3840b9810 2024-03-23T23:56:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa389200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa384147660 con 0x7fa3840b6b50 2024-03-23T23:56:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa382a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa384141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa382a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa384141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45260/0 (socket says 172.21.15.59:45260) 2024-03-23T23:56:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.311+0000 7fa382a00640 1 -- 172.21.15.59:0/3342895961 learned_addr learned my addr 172.21.15.59:0/3342895961 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:07.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.312+0000 7fa382a00640 1 -- 172.21.15.59:0/3342895961 >> v2:172.21.15.31:3300/0 conn(0x7fa3840b9810 msgr2=0x7fa384147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.312+0000 7fa383e00640 1 --2- 172.21.15.59:0/3342895961 >> v2:172.21.15.31:3300/0 conn(0x7fa3840b9810 0x7fa384147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.312+0000 7fa382a00640 1 --2- 172.21.15.59:0/3342895961 >> v2:172.21.15.31:3300/0 conn(0x7fa3840b9810 0x7fa384147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.312+0000 7fa382a00640 1 -- 172.21.15.59:0/3342895961 >> v1:172.21.15.31:6789/0 conn(0x7fa3840b50a0 legacy=0x7fa384140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.312+0000 7fa382a00640 1 -- 172.21.15.59:0/3342895961 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840b5480 con 0x7fa3840b6b50 2024-03-23T23:56:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.313+0000 7fa382a00640 1 --2- 172.21.15.59:0/3342895961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa384141340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa370009870 tx=0x7fa37002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339b73b677268e7d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:07.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.313+0000 7fa382000640 1 -- 172.21.15.59:0/3342895961 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370035020 con 0x7fa3840b6b50 2024-03-23T23:56:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.313+0000 7fa382000640 1 -- 172.21.15.59:0/3342895961 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa370031640 con 0x7fa3840b6b50 2024-03-23T23:56:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.313+0000 7fa382000640 1 -- 172.21.15.59:0/3342895961 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37002d040 con 0x7fa3840b6b50 2024-03-23T23:56:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 -- 172.21.15.59:0/3342895961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 msgr2=0x7fa384141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 --2- 172.21.15.59:0/3342895961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa384141340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa370009870 tx=0x7fa37002b8f0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 -- 172.21.15.59:0/3342895961 shutdown_connections 2024-03-23T23:56:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 --2- 172.21.15.59:0/3342895961 >> v2:172.21.15.31:3300/0 conn(0x7fa3840b9810 0x7fa384147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 --2- 172.21.15.59:0/3342895961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa384141340 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 -- 172.21.15.59:0/3342895961 >> 172.21.15.59:0/3342895961 conn(0x7fa384066dd0 msgr2=0x7fa3840671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 -- 172.21.15.59:0/3342895961 shutdown_connections 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.314+0000 7fa389200640 1 -- 172.21.15.59:0/3342895961 wait complete. 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.316+0000 7fa389200640 1 Processor -- start 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.316+0000 7fa389200640 1 -- start start 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.316+0000 7fa389200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3840b50a0 0x7fa3840bd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.316+0000 7fa389200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa3840bc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa389200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3840b9810 0x7fa3841e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa389200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840b4000 con 0x7fa3840b9810 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa389200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840b63e0 con 0x7fa3840b50a0 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa389200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3840b42e0 con 0x7fa3840b6b50 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa3840bc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa383400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3840b50a0 0x7fa3840bd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa3840bc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45276/0 (socket says 172.21.15.59:45276) 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 -- 172.21.15.59:0/782160127 learned_addr learned my addr 172.21.15.59:0/782160127 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa383e00640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3840b9810 0x7fa3841e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 -- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3840b50a0 msgr2=0x7fa3840bd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3840b50a0 0x7fa3840bd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 -- 172.21.15.59:0/782160127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3840b9810 msgr2=0x7fa3841e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3840b9810 0x7fa3841e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa382a00640 1 -- 172.21.15.59:0/782160127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840bc9e0 con 0x7fa3840b6b50 2024-03-23T23:56:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.317+0000 7fa383400640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3840b50a0 0x7fa3840bd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.318+0000 7fa382a00640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa3840bc1b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa37002b930 tx=0x7fa3700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.318+0000 7fa37b400640 1 -- 172.21.15.59:0/782160127 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370035040 con 0x7fa3840b6b50 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.318+0000 7fa37b400640 1 -- 172.21.15.59:0/782160127 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa370039bf0 con 0x7fa3840b6b50 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.318+0000 7fa37b400640 1 -- 172.21.15.59:0/782160127 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370045480 con 0x7fa3840b6b50 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.318+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3840b2f70 con 0x7fa3840b6b50 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.318+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840b2250 con 0x7fa3840b6b50 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.319+0000 7fa37b400640 1 -- 172.21.15.59:0/782160127 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa370038020 con 0x7fa3840b6b50 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.319+0000 7fa37b400640 1 -- 172.21.15.59:0/782160127 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa37003a6f0 con 0x7fa3840b6b50 2024-03-23T23:56:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.319+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3840752c0 con 0x7fa3840b6b50 2024-03-23T23:56:07.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.322+0000 7fa37b400640 1 -- 172.21.15.59:0/782160127 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa370031610 con 0x7fa3840b6b50 2024-03-23T23:56:07.332 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:07.331+0000 7f2e3543a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:56:07.384 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:07.383+0000 7f2e3543a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-23T23:56:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.401+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac629292-9951-4570-866a-fd09ad372056", "id": 4} v 0) v1 -- 0x7fa3841e0c80 con 0x7fa3840b6b50 2024-03-23T23:56:07.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.408+0000 7fa37b400640 1 -- 172.21.15.59:0/782160127 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac629292-9951-4570-866a-fd09ad372056", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa37003aa10 con 0x7fa3840b6b50 2024-03-23T23:56:07.409 INFO:teuthology.orchestra.run.smithi059.stdout:4 2024-03-23T23:56:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 msgr2=0x7fa3840bc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa3840bc1b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa37002b930 tx=0x7fa3700046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 shutdown_connections 2024-03-23T23:56:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3840b9810 0x7fa3841e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3840b6b50 0x7fa3840bc1b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 --2- 172.21.15.59:0/782160127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3840b50a0 0x7fa3840bd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 >> 172.21.15.59:0/782160127 conn(0x7fa384066dd0 msgr2=0x7fa384145370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 shutdown_connections 2024-03-23T23:56:07.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.409+0000 7fa389200640 1 -- 172.21.15.59:0/782160127 wait complete. 2024-03-23T23:56:07.424 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.424+0000 7f338201a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-23T23:56:07.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 5f26844a-4a5c-4778-9f44-d5ae00288e7b 5 2024-03-23T23:56:07.479 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.480+0000 7f338201a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-23T23:56:07.571 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:07.571+0000 7f2e3543a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-23T23:56:07.612 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.612+0000 7f338201a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:56:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.668+0000 7fa911e00640 1 Processor -- start 2024-03-23T23:56:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.668+0000 7fa911e00640 1 -- start start 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.669+0000 7fa911e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa90c1414f0 0x7fa90c152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.669+0000 7fa911e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c0b9da0 con 0x7fa90c0b6a50 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.669+0000 7fa911e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c0b4850 con 0x7fa90c0b99c0 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.669+0000 7fa911e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c0b54e0 con 0x7fa90c1414f0 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.670+0000 7fa910a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa90c0b99c0 0x7fa90c147120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42678/0 (socket says 172.21.15.59:42678) 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.670+0000 7fa910a00640 1 -- 172.21.15.59:0/744626761 learned_addr learned my addr 172.21.15.59:0/744626761 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.670+0000 7fa911400640 1 --2- 172.21.15.59:0/744626761 >> v2:172.21.15.59:3300/0 conn(0x7fa90c1414f0 0x7fa90c152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.670+0000 7fa90b400640 1 -- 172.21.15.59:0/744626761 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556275568 0 0) 0x7fa90c0b4850 con 0x7fa90c0b99c0 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.670+0000 7fa911400640 1 -- 172.21.15.59:0/744626761 >> v1:172.21.15.59:6789/0 conn(0x7fa90c0b99c0 legacy=0x7fa90c147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.670+0000 7fa911400640 1 -- 172.21.15.59:0/744626761 >> v1:172.21.15.31:6789/0 conn(0x7fa90c0b6a50 legacy=0x7fa90c140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.670+0000 7fa911400640 1 -- 172.21.15.59:0/744626761 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0b40b0 con 0x7fa90c1414f0 2024-03-23T23:56:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.672+0000 7fa911400640 1 --2- 172.21.15.59:0/744626761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c1414f0 0x7fa90c152ab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa904009d90 tx=0x7fa90402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7265cfa32ae2b08 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.672+0000 7fa90b400640 1 -- 172.21.15.59:0/744626761 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904039070 con 0x7fa90c1414f0 2024-03-23T23:56:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.672+0000 7fa90b400640 1 -- 172.21.15.59:0/744626761 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90402cbd0 con 0x7fa90c1414f0 2024-03-23T23:56:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.672+0000 7fa90b400640 1 -- 172.21.15.59:0/744626761 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904034440 con 0x7fa90c1414f0 2024-03-23T23:56:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.673+0000 7fa911e00640 1 -- 172.21.15.59:0/744626761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c1414f0 msgr2=0x7fa90c152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.673+0000 7fa911e00640 1 --2- 172.21.15.59:0/744626761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c1414f0 0x7fa90c152ab0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa904009d90 tx=0x7fa90402be20 comp rx=0 tx=0).stop 2024-03-23T23:56:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.673+0000 7fa911e00640 1 -- 172.21.15.59:0/744626761 shutdown_connections 2024-03-23T23:56:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.673+0000 7fa911e00640 1 --2- 172.21.15.59:0/744626761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c1414f0 0x7fa90c152ab0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.673+0000 7fa911e00640 1 -- 172.21.15.59:0/744626761 >> 172.21.15.59:0/744626761 conn(0x7fa90c066fb0 msgr2=0x7fa90c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.673+0000 7fa911e00640 1 -- 172.21.15.59:0/744626761 shutdown_connections 2024-03-23T23:56:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.673+0000 7fa911e00640 1 -- 172.21.15.59:0/744626761 wait complete. 2024-03-23T23:56:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.675+0000 7fa911e00640 1 Processor -- start 2024-03-23T23:56:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.675+0000 7fa911e00640 1 -- start start 2024-03-23T23:56:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c0b6a50 0x7fa90c14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c0b99c0 0x7fa90c13b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa90c1414f0 0x7fa90c13bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b62e0 con 0x7fa90c0b99c0 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b4390 con 0x7fa90c0b6a50 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0b3d60 con 0x7fa90c1414f0 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa910a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c0b6a50 0x7fa90c14a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa90c1414f0 0x7fa90c13bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa90c1414f0 0x7fa90c13bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45292/0 (socket says 172.21.15.59:45292) 2024-03-23T23:56:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa910a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c0b6a50 0x7fa90c14a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50460/0 (socket says 172.21.15.59:50460) 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa911400640 1 -- 172.21.15.59:0/2782295093 learned_addr learned my addr 172.21.15.59:0/2782295093 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.676+0000 7fa90be00640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c0b99c0 0x7fa90c13b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa911400640 1 -- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c0b6a50 msgr2=0x7fa90c14a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa911400640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c0b6a50 0x7fa90c14a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa911400640 1 -- 172.21.15.59:0/2782295093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c0b99c0 msgr2=0x7fa90c13b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa911400640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c0b99c0 0x7fa90c13b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa911400640 1 -- 172.21.15.59:0/2782295093 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c144900 con 0x7fa90c1414f0 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa910a00640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c0b6a50 0x7fa90c14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa90be00640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c0b99c0 0x7fa90c13b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa911400640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa90c1414f0 0x7fa90c13bc50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa904009eb0 tx=0x7fa904004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:07.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.677+0000 7fa908c00640 1 -- 172.21.15.59:0/2782295093 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904044020 con 0x7fa90c1414f0 2024-03-23T23:56:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.678+0000 7fa908c00640 1 -- 172.21.15.59:0/2782295093 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90403f470 con 0x7fa90c1414f0 2024-03-23T23:56:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.678+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c0aa430 con 0x7fa90c1414f0 2024-03-23T23:56:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.678+0000 7fa908c00640 1 -- 172.21.15.59:0/2782295093 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904039040 con 0x7fa90c1414f0 2024-03-23T23:56:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.678+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c144590 con 0x7fa90c1414f0 2024-03-23T23:56:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.678+0000 7fa908c00640 1 -- 172.21.15.59:0/2782295093 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa904047020 con 0x7fa90c1414f0 2024-03-23T23:56:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.678+0000 7fa908c00640 1 -- 172.21.15.59:0/2782295093 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fa904040ab0 con 0x7fa90c1414f0 2024-03-23T23:56:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.679+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c0752c0 con 0x7fa90c1414f0 2024-03-23T23:56:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.681+0000 7fa908c00640 1 -- 172.21.15.59:0/2782295093 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa90404e030 con 0x7fa90c1414f0 2024-03-23T23:56:07.728 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.728+0000 7f338201a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-23T23:56:07.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.761+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f26844a-4a5c-4778-9f44-d5ae00288e7b", "id": 5} v 0) v1 -- 0x7fa90c144c50 con 0x7fa90c1414f0 2024-03-23T23:56:07.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.769+0000 7fa908c00640 1 -- 172.21.15.59:0/2782295093 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f26844a-4a5c-4778-9f44-d5ae00288e7b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa90403fd60 con 0x7fa90c1414f0 2024-03-23T23:56:07.770 INFO:teuthology.orchestra.run.smithi059.stdout:5 2024-03-23T23:56:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa90c1414f0 msgr2=0x7fa90c13bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa90c1414f0 0x7fa90c13bc50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa904009eb0 tx=0x7fa904004a40 comp rx=0 tx=0).stop 2024-03-23T23:56:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 shutdown_connections 2024-03-23T23:56:07.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa90c1414f0 0x7fa90c13bc50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa90c0b99c0 0x7fa90c13b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 --2- 172.21.15.59:0/2782295093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa90c0b6a50 0x7fa90c14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 >> 172.21.15.59:0/2782295093 conn(0x7fa90c066fb0 msgr2=0x7fa90c0b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 shutdown_connections 2024-03-23T23:56:07.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.771+0000 7fa911e00640 1 -- 172.21.15.59:0/2782295093 wait complete. 2024-03-23T23:56:07.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 9c7becfe-366a-45fd-8a13-f2b7a336482b 6 2024-03-23T23:56:07.914 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.914+0000 7f338201a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-23T23:56:07.966 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:07.966+0000 7f338201a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-23T23:56:07.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.975+0000 7f29c9a00640 1 Processor -- start 2024-03-23T23:56:07.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.975+0000 7f29c9a00640 1 -- start start 2024-03-23T23:56:07.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.976+0000 7f29c9a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c406be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c9a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f29c406c3b0 0x7f29c4146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c9a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c40b4be0 con 0x7f29c41471f0 2024-03-23T23:56:07.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c9a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c40ae500 con 0x7f29c406c3b0 2024-03-23T23:56:07.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c9a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40af830 con 0x7f29c40b4800 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c406be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45296/0 (socket says 172.21.15.59:45296) 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3e00640 1 -- 172.21.15.59:0/127574137 learned_addr learned my addr 172.21.15.59:0/127574137 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3400640 1 --2- 172.21.15.59:0/127574137 >> v2:172.21.15.31:3300/0 conn(0x7f29c406c3b0 0x7f29c4146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3e00640 1 -- 172.21.15.59:0/127574137 >> v2:172.21.15.31:3300/0 conn(0x7f29c406c3b0 msgr2=0x7f29c4146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3e00640 1 --2- 172.21.15.59:0/127574137 >> v2:172.21.15.31:3300/0 conn(0x7f29c406c3b0 0x7f29c4146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3e00640 1 -- 172.21.15.59:0/127574137 >> v1:172.21.15.31:6789/0 conn(0x7f29c41471f0 legacy=0x7f29c4143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:07.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.977+0000 7f29c3e00640 1 -- 172.21.15.59:0/127574137 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c409e3a0 con 0x7f29c40b4800 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.979+0000 7f29c3e00640 1 --2- 172.21.15.59:0/127574137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c406be70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29b400bb00 tx=0x7f29b402dd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38644b739f9c72a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.979+0000 7f29c2a00640 1 -- 172.21.15.59:0/127574137 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4034070 con 0x7f29c40b4800 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.979+0000 7f29c2a00640 1 -- 172.21.15.59:0/127574137 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b402eb30 con 0x7f29c40b4800 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.979+0000 7f29c2a00640 1 -- 172.21.15.59:0/127574137 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4038400 con 0x7f29c40b4800 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.979+0000 7f29c9a00640 1 -- 172.21.15.59:0/127574137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 msgr2=0x7f29c406be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.979+0000 7f29c9a00640 1 --2- 172.21.15.59:0/127574137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c406be70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29b400bb00 tx=0x7f29b402dd80 comp rx=0 tx=0).stop 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.980+0000 7f29c9a00640 1 -- 172.21.15.59:0/127574137 shutdown_connections 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.980+0000 7f29c9a00640 1 --2- 172.21.15.59:0/127574137 >> v2:172.21.15.31:3300/0 conn(0x7f29c406c3b0 0x7f29c4146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.980+0000 7f29c9a00640 1 --2- 172.21.15.59:0/127574137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c406be70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.980+0000 7f29c9a00640 1 -- 172.21.15.59:0/127574137 >> 172.21.15.59:0/127574137 conn(0x7f29c40b91b0 msgr2=0x7f29c40b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:07.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.980+0000 7f29c9a00640 1 -- 172.21.15.59:0/127574137 shutdown_connections 2024-03-23T23:56:07.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.980+0000 7f29c9a00640 1 -- 172.21.15.59:0/127574137 wait complete. 2024-03-23T23:56:07.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.981+0000 7f29c9a00640 1 Processor -- start 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.981+0000 7f29c9a00640 1 -- start start 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c9a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c406c3b0 0x7f29c40b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c9a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c409ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c41471f0 0x7f29c409b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c9a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40ae190 con 0x7f29c406c3b0 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c9a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40afb10 con 0x7f29c41471f0 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c9a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40adb00 con 0x7f29c40b4800 2024-03-23T23:56:07.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c3400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c409ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c3400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c409ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:45304/0 (socket says 172.21.15.59:45304) 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c41471f0 0x7f29c409b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.982+0000 7f29c3400640 1 -- 172.21.15.59:0/768812845 learned_addr learned my addr 172.21.15.59:0/768812845 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29c3e00640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c406c3b0 0x7f29c40b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29c3400640 1 -- 172.21.15.59:0/768812845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c41471f0 msgr2=0x7f29c409b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29c3400640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c41471f0 0x7f29c409b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29c3400640 1 -- 172.21.15.59:0/768812845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c406c3b0 msgr2=0x7f29c40b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29c3400640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c406c3b0 0x7f29c40b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29c3400640 1 -- 172.21.15.59:0/768812845 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c409cbb0 con 0x7f29c40b4800 2024-03-23T23:56:07.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29c3400640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c409ae60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29b000d7d0 tx=0x7f29b000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29bbe00640 1 -- 172.21.15.59:0/768812845 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000b6c0 con 0x7f29c40b4800 2024-03-23T23:56:07.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29bbe00640 1 -- 172.21.15.59:0/768812845 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b0019070 con 0x7f29c40b4800 2024-03-23T23:56:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.983+0000 7f29bbe00640 1 -- 172.21.15.59:0/768812845 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000ba80 con 0x7f29c40b4800 2024-03-23T23:56:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.984+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c40b02b0 con 0x7f29c40b4800 2024-03-23T23:56:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.984+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c40b0870 con 0x7f29c40b4800 2024-03-23T23:56:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.984+0000 7f29bbe00640 1 -- 172.21.15.59:0/768812845 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f29b000bc20 con 0x7f29c40b4800 2024-03-23T23:56:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.984+0000 7f29bbe00640 1 -- 172.21.15.59:0/768812845 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f29b001ea50 con 0x7f29c40b4800 2024-03-23T23:56:07.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.985+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c40752c0 con 0x7f29c40b4800 2024-03-23T23:56:07.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:07.987+0000 7f29bbe00640 1 -- 172.21.15.59:0/768812845 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f29b001e460 con 0x7f29c40b4800 2024-03-23T23:56:08.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.068+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9c7becfe-366a-45fd-8a13-f2b7a336482b", "id": 6} v 0) v1 -- 0x7f29c40b2870 con 0x7f29c40b4800 2024-03-23T23:56:08.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.074+0000 7f29bbe00640 1 -- 172.21.15.59:0/768812845 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c7becfe-366a-45fd-8a13-f2b7a336482b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f29b001e640 con 0x7f29c40b4800 2024-03-23T23:56:08.075 INFO:teuthology.orchestra.run.smithi059.stdout:6 2024-03-23T23:56:08.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.075+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 msgr2=0x7f29c409ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.075+0000 7f29c9a00640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c409ae60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29b000d7d0 tx=0x7f29b000dc90 comp rx=0 tx=0).stop 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.075+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 shutdown_connections 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.076+0000 7f29c9a00640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c41471f0 0x7f29c409b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.076+0000 7f29c9a00640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29c40b4800 0x7f29c409ae60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.076+0000 7f29c9a00640 1 --2- 172.21.15.59:0/768812845 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c406c3b0 0x7f29c40b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.076+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 >> 172.21.15.59:0/768812845 conn(0x7f29c40b91b0 msgr2=0x7f29c4068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.076+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 shutdown_connections 2024-03-23T23:56:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.076+0000 7f29c9a00640 1 -- 172.21.15.59:0/768812845 wait complete. 2024-03-23T23:56:08.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 9d6fb05f-9474-427e-99c6-3aaf270b8177 7 2024-03-23T23:56:08.151 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:08.150+0000 7f338201a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-23T23:56:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.282+0000 7fc6cdc00640 1 Processor -- start 2024-03-23T23:56:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.282+0000 7fc6cdc00640 1 -- start start 2024-03-23T23:56:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.283+0000 7fc6cdc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6c8147c40 0x7fc6c8072000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.284+0000 7fc6cdc00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80b5710 con 0x7fc6c8071c20 2024-03-23T23:56:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.284+0000 7fc6cdc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80b59f0 con 0x7fc6c8141150 2024-03-23T23:56:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.284+0000 7fc6cdc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c8072b20 con 0x7fc6c8147c40 2024-03-23T23:56:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.284+0000 7fc6c6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6c8147c40 0x7fc6c8072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.284+0000 7fc6c6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6c8147c40 0x7fc6c8072000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50470/0 (socket says 172.21.15.59:50470) 2024-03-23T23:56:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.284+0000 7fc6c6000640 1 -- 172.21.15.59:0/13288154 learned_addr learned my addr 172.21.15.59:0/13288154 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.284+0000 7fc6c6000640 1 -- 172.21.15.59:0/13288154 >> v1:172.21.15.59:6789/0 conn(0x7fc6c8141150 legacy=0x7fc6c81415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.285+0000 7fc6c6000640 1 -- 172.21.15.59:0/13288154 >> v1:172.21.15.31:6789/0 conn(0x7fc6c8071c20 legacy=0x7fc6c8147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.285+0000 7fc6c6000640 1 -- 172.21.15.59:0/13288154 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c80b5cd0 con 0x7fc6c8147c40 2024-03-23T23:56:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.286+0000 7fc6c6000640 1 --2- 172.21.15.59:0/13288154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8147c40 0x7fc6c8072000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009870 tx=0x7fc6b402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb89d9e0605a3daa server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.286+0000 7fc6c5600640 1 -- 172.21.15.59:0/13288154 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4035020 con 0x7fc6c8147c40 2024-03-23T23:56:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.286+0000 7fc6c5600640 1 -- 172.21.15.59:0/13288154 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4031870 con 0x7fc6c8147c40 2024-03-23T23:56:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.286+0000 7fc6c5600640 1 -- 172.21.15.59:0/13288154 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4031c40 con 0x7fc6c8147c40 2024-03-23T23:56:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.287+0000 7fc6cdc00640 1 -- 172.21.15.59:0/13288154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8147c40 msgr2=0x7fc6c8072000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.287+0000 7fc6cdc00640 1 --2- 172.21.15.59:0/13288154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8147c40 0x7fc6c8072000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009870 tx=0x7fc6b402b910 comp rx=0 tx=0).stop 2024-03-23T23:56:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.287+0000 7fc6cdc00640 1 -- 172.21.15.59:0/13288154 shutdown_connections 2024-03-23T23:56:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.287+0000 7fc6cdc00640 1 --2- 172.21.15.59:0/13288154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8147c40 0x7fc6c8072000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.287+0000 7fc6cdc00640 1 -- 172.21.15.59:0/13288154 >> 172.21.15.59:0/13288154 conn(0x7fc6c80b98c0 msgr2=0x7fc6c80b9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.287+0000 7fc6cdc00640 1 -- 172.21.15.59:0/13288154 shutdown_connections 2024-03-23T23:56:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.287+0000 7fc6cdc00640 1 -- 172.21.15.59:0/13288154 wait complete. 2024-03-23T23:56:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.288+0000 7fc6cdc00640 1 Processor -- start 2024-03-23T23:56:08.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.289+0000 7fc6cdc00640 1 -- start start 2024-03-23T23:56:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.289+0000 7fc6cdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8071c20 0x7fc6c80af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.289+0000 7fc6cdc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c8141150 0x7fc6c81dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.289+0000 7fc6cdc00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6c8147c40 0x7fc6c81e0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.289+0000 7fc6cdc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80728e0 con 0x7fc6c8141150 2024-03-23T23:56:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.289+0000 7fc6cdc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8072760 con 0x7fc6c8071c20 2024-03-23T23:56:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.289+0000 7fc6cdc00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8152c90 con 0x7fc6c8147c40 2024-03-23T23:56:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8071c20 0x7fc6c80af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c7400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6c8147c40 0x7fc6c81e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8071c20 0x7fc6c80af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50478/0 (socket says 172.21.15.59:50478) 2024-03-23T23:56:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c6a00640 1 -- 172.21.15.59:0/801734199 learned_addr learned my addr 172.21.15.59:0/801734199 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-03-23T23:56:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c6000640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c8141150 0x7fc6c81dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c7400640 1 -- 172.21.15.59:0/801734199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8071c20 msgr2=0x7fc6c80af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c7400640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8071c20 0x7fc6c80af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c7400640 1 -- 172.21.15.59:0/801734199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c8141150 msgr2=0x7fc6c81dcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c7400640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c8141150 0x7fc6c81dcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.290+0000 7fc6c7400640 1 -- 172.21.15.59:0/801734199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c813cd10 con 0x7fc6c8147c40 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6c7400640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6c8147c40 0x7fc6c81e0360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c6c0 tx=0x7fc6c000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6bea00640 1 -- 172.21.15.59:0/801734199 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0003b70 con 0x7fc6c8147c40 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6bea00640 1 -- 172.21.15.59:0/801734199 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c0003d10 con 0x7fc6c8147c40 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6bea00640 1 -- 172.21.15.59:0/801734199 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c00052f0 con 0x7fc6c8147c40 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c813b800 con 0x7fc6c8147c40 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c80b3730 con 0x7fc6c8147c40 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6bea00640 1 -- 172.21.15.59:0/801734199 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc6c0005490 con 0x7fc6c8147c40 2024-03-23T23:56:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.291+0000 7fc6bea00640 1 -- 172.21.15.59:0/801734199 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc6c0005780 con 0x7fc6c8147c40 2024-03-23T23:56:08.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.293+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c804f400 con 0x7fc6c8147c40 2024-03-23T23:56:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.295+0000 7fc6bea00640 1 -- 172.21.15.59:0/801734199 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc6c000a640 con 0x7fc6c8147c40 2024-03-23T23:56:08.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.378+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9d6fb05f-9474-427e-99c6-3aaf270b8177", "id": 7} v 0) v1 -- 0x7fc6c80b9da0 con 0x7fc6c8147c40 2024-03-23T23:56:08.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.387+0000 7fc6bea00640 1 -- 172.21.15.59:0/801734199 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d6fb05f-9474-427e-99c6-3aaf270b8177", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6c000a820 con 0x7fc6c8147c40 2024-03-23T23:56:08.388 INFO:teuthology.orchestra.run.smithi059.stdout:7 2024-03-23T23:56:08.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.388+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6c8147c40 msgr2=0x7fc6c81e0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.388+0000 7fc6cdc00640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6c8147c40 0x7fc6c81e0360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c6c0 tx=0x7fc6c000cb80 comp rx=0 tx=0).stop 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.389+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 shutdown_connections 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.389+0000 7fc6cdc00640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6c8147c40 0x7fc6c81e0360 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.389+0000 7fc6cdc00640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc6c8141150 0x7fc6c81dcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.389+0000 7fc6cdc00640 1 --2- 172.21.15.59:0/801734199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6c8071c20 0x7fc6c80af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.389+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 >> 172.21.15.59:0/801734199 conn(0x7fc6c80b98c0 msgr2=0x7fc6c80b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.389+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 shutdown_connections 2024-03-23T23:56:08.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-03-23T23:56:08.389+0000 7fc6cdc00640 1 -- 172.21.15.59:0/801734199 wait complete. 2024-03-23T23:56:08.406 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-23T23:56:08.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-23T23:56:08.414 INFO:tasks.ceph.osd.0:Started 2024-03-23T23:56:08.414 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-23T23:56:08.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-23T23:56:08.421 INFO:tasks.ceph.osd.1:Started 2024-03-23T23:56:08.421 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-23T23:56:08.421 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-23T23:56:08.429 INFO:tasks.ceph.osd.2:Started 2024-03-23T23:56:08.429 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-23T23:56:08.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-23T23:56:08.434 INFO:tasks.ceph.osd.3:Started 2024-03-23T23:56:08.434 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-23T23:56:08.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-23T23:56:08.441 INFO:tasks.ceph.osd.4:Started 2024-03-23T23:56:08.441 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-23T23:56:08.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-23T23:56:08.448 INFO:tasks.ceph.osd.5:Started 2024-03-23T23:56:08.448 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-23T23:56:08.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-23T23:56:08.453 INFO:tasks.ceph.osd.6:Started 2024-03-23T23:56:08.453 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-23T23:56:08.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-23T23:56:08.459 INFO:tasks.ceph.osd.7:Started 2024-03-23T23:56:08.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.658+0000 7efe74400640 1 Processor -- start 2024-03-23T23:56:08.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.659+0000 7efe74400640 1 -- start start 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe74400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c0b6740 0x7efe6c070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe74400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe6c13e350 0x7efe6c0b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe74400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c0b6b20 con 0x7efe6c13def0 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe74400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6c147620 con 0x7efe6c13e350 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe74400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c0b5b90 con 0x7efe6c0b6740 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe72400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe6c13e350 0x7efe6c0b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe72400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe6c13e350 0x7efe6c0b4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37866/0 (socket says 172.21.15.31:37866) 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe71000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efe6c13def0 0x7efe6c0b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:42612/0 (socket says 172.21.15.31:42612) 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe72400640 1 -- 172.21.15.31:0/2713098232 learned_addr learned my addr 172.21.15.31:0/2713098232 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:08.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe71a00640 1 --2- 172.21.15.31:0/2713098232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c0b6740 0x7efe6c070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe72400640 1 -- 172.21.15.31:0/2713098232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c0b6740 msgr2=0x7efe6c070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:08.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe72400640 1 --2- 172.21.15.31:0/2713098232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c0b6740 0x7efe6c070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe72400640 1 -- 172.21.15.31:0/2713098232 >> v1:172.21.15.59:6789/0 conn(0x7efe6c13def0 legacy=0x7efe6c0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.660+0000 7efe72400640 1 -- 172.21.15.31:0/2713098232 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c0b0b80 con 0x7efe6c13e350 2024-03-23T23:56:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.661+0000 7efe72400640 1 --2- 172.21.15.31:0/2713098232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c13e350 0x7efe6c0b4b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efe64009e50 tx=0x7efe6402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8424935ce9fd4153 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe6be00640 1 -- 172.21.15.31:0/2713098232 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6402cb00 con 0x7efe6c13e350 2024-03-23T23:56:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe6be00640 1 -- 172.21.15.31:0/2713098232 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6402cca0 con 0x7efe6c13e350 2024-03-23T23:56:08.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe6be00640 1 -- 172.21.15.31:0/2713098232 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64034610 con 0x7efe6c13e350 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe74400640 1 -- 172.21.15.31:0/2713098232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c13e350 msgr2=0x7efe6c0b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe74400640 1 --2- 172.21.15.31:0/2713098232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c13e350 0x7efe6c0b4b70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efe64009e50 tx=0x7efe6402bf60 comp rx=0 tx=0).stop 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe74400640 1 -- 172.21.15.31:0/2713098232 shutdown_connections 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe74400640 1 --2- 172.21.15.31:0/2713098232 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c13e350 0x7efe6c0b4b70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe74400640 1 --2- 172.21.15.31:0/2713098232 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c0b6740 0x7efe6c070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe74400640 1 -- 172.21.15.31:0/2713098232 >> 172.21.15.31:0/2713098232 conn(0x7efe6c066dd0 msgr2=0x7efe6c0671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.662+0000 7efe74400640 1 -- 172.21.15.31:0/2713098232 shutdown_connections 2024-03-23T23:56:08.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.663+0000 7efe74400640 1 -- 172.21.15.31:0/2713098232 wait complete. 2024-03-23T23:56:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.664+0000 7efe74400640 1 Processor -- start 2024-03-23T23:56:08.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.664+0000 7efe74400640 1 -- start start 2024-03-23T23:56:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe74400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c0b6740 0x7efe6c0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe74400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6c13def0 0x7efe6c13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe74400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c13e350 0x7efe6c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe74400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c06fee0 con 0x7efe6c0b6740 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe74400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c071280 con 0x7efe6c13def0 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe74400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c070060 con 0x7efe6c13e350 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c0b6740 0x7efe6c0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c0b6740 0x7efe6c0b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37882/0 (socket says 172.21.15.31:37882) 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 -- 172.21.15.31:0/2584503178 learned_addr learned my addr 172.21.15.31:0/2584503178 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71000640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6c13def0 0x7efe6c13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe72400640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c13e350 0x7efe6c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:08.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 -- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c13e350 msgr2=0x7efe6c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c13e350 0x7efe6c0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 -- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6c13def0 msgr2=0x7efe6c13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6c13def0 0x7efe6c13ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71a00640 1 -- 172.21.15.31:0/2584503178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c141980 con 0x7efe6c0b6740 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe72400640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c13e350 0x7efe6c0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.665+0000 7efe71000640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6c13def0 0x7efe6c13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.666+0000 7efe71a00640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c0b6740 0x7efe6c0b3760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efe6000e9e0 tx=0x7efe6000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.666+0000 7efe69600640 1 -- 172.21.15.31:0/2584503178 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60017070 con 0x7efe6c0b6740 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.666+0000 7efe69600640 1 -- 172.21.15.31:0/2584503178 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6000c9d0 con 0x7efe6c0b6740 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.666+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c070960 con 0x7efe6c0b6740 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.666+0000 7efe69600640 1 -- 172.21.15.31:0/2584503178 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6000cdc0 con 0x7efe6c0b6740 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.666+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c140f50 con 0x7efe6c0b6740 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.667+0000 7efe69600640 1 -- 172.21.15.31:0/2584503178 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efe6001a070 con 0x7efe6c0b6740 2024-03-23T23:56:08.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.667+0000 7efe69600640 1 -- 172.21.15.31:0/2584503178 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7efe600066b0 con 0x7efe6c0b6740 2024-03-23T23:56:08.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.667+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c04f400 con 0x7efe6c0b6740 2024-03-23T23:56:08.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.672+0000 7efe69600640 1 -- 172.21.15.31:0/2584503178 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efe60005990 con 0x7efe6c0b6740 2024-03-23T23:56:08.731 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:08.730+0000 7f2e3543a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-23T23:56:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.737+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe6c0b2920 con 0x7efe6c0b6740 2024-03-23T23:56:08.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.738+0000 7efe69600640 1 -- 172.21.15.31:0/2584503178 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7efe60005b70 con 0x7efe6c0b6740 2024-03-23T23:56:08.738 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:08.738 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:08.381329+0000","last_up_change":"0.000000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c0b6740 msgr2=0x7efe6c0b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c0b6740 0x7efe6c0b3760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efe6000e9e0 tx=0x7efe6000eea0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 shutdown_connections 2024-03-23T23:56:08.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe6c13def0 0x7efe6c13ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe6c13e350 0x7efe6c0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 --2- 172.21.15.31:0/2584503178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe6c0b6740 0x7efe6c0b3760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 >> 172.21.15.31:0/2584503178 conn(0x7efe6c066dd0 msgr2=0x7efe6c06b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 shutdown_connections 2024-03-23T23:56:08.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:08.739+0000 7efe74400640 1 -- 172.21.15.31:0/2584503178 wait complete. 2024-03-23T23:56:08.756 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-23T23:56:08.756 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-23T23:56:09.080 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:09.079+0000 7f2e3543a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-23T23:56:09.129 INFO:tasks.ceph.osd.5.smithi059.stderr:2024-03-23T23:56:09.129+0000 7f57ed424640 -1 Falling back to public interface 2024-03-23T23:56:09.137 INFO:tasks.ceph.osd.7.smithi059.stderr:2024-03-23T23:56:09.137+0000 7f9b05413640 -1 Falling back to public interface 2024-03-23T23:56:09.142 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-03-23T23:56:09.142+0000 7f68a8813640 -1 Falling back to public interface 2024-03-23T23:56:09.142 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:09.142+0000 7f2e3543a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-23T23:56:09.154 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-03-23T23:56:09.154+0000 7fd8dab16640 -1 Falling back to public interface 2024-03-23T23:56:09.155 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-03-23T23:56:09.155+0000 7fbb6921f640 -1 Falling back to public interface 2024-03-23T23:56:09.162 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-03-23T23:56:09.163+0000 7f801fc11640 -1 Falling back to public interface 2024-03-23T23:56:09.172 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-03-23T23:56:09.172+0000 7f6d538c1640 -1 Falling back to public interface 2024-03-23T23:56:09.172 INFO:tasks.ceph.osd.6.smithi059.stderr:2024-03-23T23:56:09.172+0000 7f8bc280c640 -1 Falling back to public interface 2024-03-23T23:56:09.286 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:09.285+0000 7f2e3543a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-23T23:56:09.334 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:09.334+0000 7f338201a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-23T23:56:09.562 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:09.665 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:09.664+0000 7f338201a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-23T23:56:09.719 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.719+0000 7f1dbf000640 1 Processor -- start 2024-03-23T23:56:09.720 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.720+0000 7f1dbf000640 1 -- start start 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1dbf000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1db80b21f0 0x7f1db80b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1dbf000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1db813efd0 0x7f1db813f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1dbf000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db813f9a0 con 0x7f1db8145240 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1dbf000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db80b2c70 con 0x7f1db80b21f0 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1dbf000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db80b47d0 con 0x7f1db813efd0 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1db7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1db80b21f0 0x7f1db80b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1db7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1db80b21f0 0x7f1db80b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37886/0 (socket says 172.21.15.31:37886) 2024-03-23T23:56:09.721 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1db7e00640 1 -- 172.21.15.31:0/3259233479 learned_addr learned my addr 172.21.15.31:0/3259233479 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:09.722 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.721+0000 7f1db7400640 1 --2- 172.21.15.31:0/3259233479 >> v2:172.21.15.59:3300/0 conn(0x7f1db813efd0 0x7f1db813f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:09.722 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.722+0000 7f1db7e00640 1 -- 172.21.15.31:0/3259233479 >> v2:172.21.15.59:3300/0 conn(0x7f1db813efd0 msgr2=0x7f1db813f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:09.722 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.722+0000 7f1db7e00640 1 --2- 172.21.15.31:0/3259233479 >> v2:172.21.15.59:3300/0 conn(0x7f1db813efd0 0x7f1db813f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.722 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.722+0000 7f1db7e00640 1 -- 172.21.15.31:0/3259233479 >> v1:172.21.15.59:6789/0 conn(0x7f1db8145240 legacy=0x7f1db8145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:09.722 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.722+0000 7f1db7e00640 1 -- 172.21.15.31:0/3259233479 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80b61b0 con 0x7f1db80b21f0 2024-03-23T23:56:09.723 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.723+0000 7f1db7e00640 1 --2- 172.21.15.31:0/3259233479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db80b25d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1db806da10 tx=0x7f1da802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6da17bef55f364 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:09.723 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.723+0000 7f1db6a00640 1 -- 172.21.15.31:0/3259233479 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8038070 con 0x7f1db80b21f0 2024-03-23T23:56:09.723 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.723+0000 7f1db6a00640 1 -- 172.21.15.31:0/3259233479 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da802f050 con 0x7f1db80b21f0 2024-03-23T23:56:09.723 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.723+0000 7f1db6a00640 1 -- 172.21.15.31:0/3259233479 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8031970 con 0x7f1db80b21f0 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 -- 172.21.15.31:0/3259233479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 msgr2=0x7f1db80b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 --2- 172.21.15.31:0/3259233479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db80b25d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1db806da10 tx=0x7f1da802b7f0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 -- 172.21.15.31:0/3259233479 shutdown_connections 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 --2- 172.21.15.31:0/3259233479 >> v2:172.21.15.59:3300/0 conn(0x7f1db813efd0 0x7f1db813f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 --2- 172.21.15.31:0/3259233479 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db80b25d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 -- 172.21.15.31:0/3259233479 >> 172.21.15.31:0/3259233479 conn(0x7f1db80b5370 msgr2=0x7f1db80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 -- 172.21.15.31:0/3259233479 shutdown_connections 2024-03-23T23:56:09.724 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.724+0000 7f1dbf000640 1 -- 172.21.15.31:0/3259233479 wait complete. 2024-03-23T23:56:09.725 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.725+0000 7f1dbf000640 1 Processor -- start 2024-03-23T23:56:09.725 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.725+0000 7f1dbf000640 1 -- start start 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1dbf000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db813dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1dbf000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db813efd0 0x7f1db813a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1dbf000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1db8145240 0x7f1db81de2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1dbf000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b5160 con 0x7f1db80b21f0 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1dbf000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b4fe0 con 0x7f1db813efd0 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1dbf000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db814fae0 con 0x7f1db8145240 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db813dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:09.727 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db813dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37896/0 (socket says 172.21.15.31:37896) 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.726+0000 7f1db7e00640 1 -- 172.21.15.31:0/3167542957 learned_addr learned my addr 172.21.15.31:0/3167542957 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7400640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db813efd0 0x7f1db813a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7e00640 1 -- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1db8145240 msgr2=0x7f1db81de2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1dbd000640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1db8145240 0x7f1db81de2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7e00640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1db8145240 0x7f1db81de2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7e00640 1 -- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db813efd0 msgr2=0x7f1db813a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7e00640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db813efd0 0x7f1db813a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7e00640 1 -- 172.21.15.31:0/3167542957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8135c10 con 0x7f1db80b21f0 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7400640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db813efd0 0x7f1db813a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:09.728 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.727+0000 7f1db7e00640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db813dad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1da802b830 tx=0x7f1da80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:09.729 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.728+0000 7f1dafe00640 1 -- 172.21.15.31:0/3167542957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8042070 con 0x7f1db80b21f0 2024-03-23T23:56:09.729 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.728+0000 7f1dafe00640 1 -- 172.21.15.31:0/3167542957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da803d870 con 0x7f1db80b21f0 2024-03-23T23:56:09.729 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.728+0000 7f1dafe00640 1 -- 172.21.15.31:0/3167542957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da8038040 con 0x7f1db80b21f0 2024-03-23T23:56:09.729 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.728+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db81de800 con 0x7f1db80b21f0 2024-03-23T23:56:09.729 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.728+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db8139ab0 con 0x7f1db80b21f0 2024-03-23T23:56:09.729 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.729+0000 7f1dafe00640 1 -- 172.21.15.31:0/3167542957 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 2) v1 ==== 45093+0+0 (secure 0 0 0) 0x7f1da8045070 con 0x7f1db80b21f0 2024-03-23T23:56:09.729 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.729+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db8075260 con 0x7f1db80b21f0 2024-03-23T23:56:09.730 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.730+0000 7f1dafe00640 1 -- 172.21.15.31:0/3167542957 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1da806bd50 con 0x7f1db80b21f0 2024-03-23T23:56:09.730 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:09.730+0000 7f338201a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-23T23:56:09.732 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.732+0000 7f1dafe00640 1 -- 172.21.15.31:0/3167542957 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1da8032c70 con 0x7f1db80b21f0 2024-03-23T23:56:09.800 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.800+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1db8139c80 con 0x7f1db80b21f0 2024-03-23T23:56:09.800 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.800+0000 7f1dafe00640 1 -- 172.21.15.31:0/3167542957 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f1da8033960 con 0x7f1db80b21f0 2024-03-23T23:56:09.801 INFO:teuthology.misc.health.smithi031.stdout: 2024-03-23T23:56:09.801 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":10,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:08.381329+0000","last_up_change":"0.000000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 msgr2=0x7f1db813dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db813dad0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1da802b830 tx=0x7f1da80046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 shutdown_connections 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1db813efd0 0x7f1db813a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1db8145240 0x7f1db81de2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 --2- 172.21.15.31:0/3167542957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1db80b21f0 0x7f1db813dad0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 >> 172.21.15.31:0/3167542957 conn(0x7f1db80b5370 msgr2=0x7f1db80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:09.802 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 shutdown_connections 2024-03-23T23:56:09.803 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:09.802+0000 7f1dbf000640 1 -- 172.21.15.31:0/3167542957 wait complete. 2024-03-23T23:56:09.814 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-23T23:56:09.868 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-03-23T23:56:09.868+0000 7f338201a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-23T23:56:10.329 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:10.329+0000 7f2dd5e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-23T23:56:10.333 INFO:tasks.ceph.mgr.x.smithi059.stderr:2024-03-23T23:56:10.331+0000 7f2dd5e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-23T23:56:12.427 INFO:tasks.ceph.osd.5.smithi059.stderr:2024-03-23T23:56:12.426+0000 7f57ed424640 -1 osd.5 0 log_to_monitors true 2024-03-23T23:56:12.486 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-03-23T23:56:12.486+0000 7f801fc11640 -1 osd.3 0 log_to_monitors true 2024-03-23T23:56:12.666 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-03-23T23:56:12.666+0000 7f68a8813640 -1 osd.1 0 log_to_monitors true 2024-03-23T23:56:12.673 INFO:tasks.ceph.osd.7.smithi059.stderr:2024-03-23T23:56:12.673+0000 7f9b05413640 -1 osd.7 0 log_to_monitors true 2024-03-23T23:56:12.709 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-03-23T23:56:12.709+0000 7fd8dab16640 -1 osd.2 0 log_to_monitors true 2024-03-23T23:56:12.733 INFO:tasks.ceph.osd.6.smithi059.stderr:2024-03-23T23:56:12.732+0000 7f8bc280c640 -1 osd.6 0 log_to_monitors true 2024-03-23T23:56:12.733 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-03-23T23:56:12.733+0000 7fbb6921f640 -1 osd.0 0 log_to_monitors true 2024-03-23T23:56:12.746 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-03-23T23:56:12.746+0000 7f6d538c1640 -1 osd.4 0 log_to_monitors true 2024-03-23T23:56:14.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:56:14.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:56:16.622 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:16.641 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-03-23T23:56:16.642+0000 7fbb63c00640 -1 osd.0 0 waiting for initial osdmap 2024-03-23T23:56:16.649 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-03-23T23:56:16.649+0000 7fbb59c00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.721 INFO:tasks.ceph.osd.6.smithi059.stderr:2024-03-23T23:56:16.721+0000 7f8bbda00640 -1 osd.6 0 waiting for initial osdmap 2024-03-23T23:56:16.728 INFO:tasks.ceph.osd.6.smithi059.stderr:2024-03-23T23:56:16.728+0000 7f8bb3000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.732 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-03-23T23:56:16.733+0000 7f801a400640 -1 osd.3 0 waiting for initial osdmap 2024-03-23T23:56:16.735 INFO:tasks.ceph.osd.7.smithi059.stderr:2024-03-23T23:56:16.735+0000 7f9b00600640 -1 osd.7 0 waiting for initial osdmap 2024-03-23T23:56:16.736 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-03-23T23:56:16.736+0000 7f68a4000640 -1 osd.1 0 waiting for initial osdmap 2024-03-23T23:56:16.740 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-03-23T23:56:16.740+0000 7f8010400640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.742 INFO:tasks.ceph.osd.7.smithi059.stderr:2024-03-23T23:56:16.742+0000 7f9af5c00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.749 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-03-23T23:56:16.749+0000 7f6899600640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.751 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-03-23T23:56:16.751+0000 7f6d4f200640 -1 osd.4 0 waiting for initial osdmap 2024-03-23T23:56:16.761 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-03-23T23:56:16.760+0000 7f6d44800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.771 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-03-23T23:56:16.771+0000 7fd8d5a00640 -1 osd.2 0 waiting for initial osdmap 2024-03-23T23:56:16.787 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-03-23T23:56:16.787+0000 7fd8cba00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.791 INFO:tasks.ceph.osd.5.smithi059.stderr:2024-03-23T23:56:16.791+0000 7f57e8200640 -1 osd.5 0 waiting for initial osdmap 2024-03-23T23:56:16.798 INFO:tasks.ceph.osd.5.smithi059.stderr:2024-03-23T23:56:16.798+0000 7f57de200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T23:56:16.811 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.811+0000 7f4dfea00640 1 Processor -- start 2024-03-23T23:56:16.811 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.811+0000 7f4dfea00640 1 -- start start 2024-03-23T23:56:16.812 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.812+0000 7f4dfea00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80b21f0 0x7f4df80b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.812 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.812+0000 7f4dfea00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df80b2c70 con 0x7f4df8145240 2024-03-23T23:56:16.812 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.812+0000 7f4dfea00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df80b47d0 con 0x7f4df813efd0 2024-03-23T23:56:16.812 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.812+0000 7f4dfea00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df80b61b0 con 0x7f4df80b21f0 2024-03-23T23:56:16.813 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.812+0000 7f4dfca00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4df8145240 0x7f4df8145690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54810/0 (socket says 172.21.15.31:54810) 2024-03-23T23:56:16.813 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.812+0000 7f4dfca00640 1 -- 172.21.15.31:0/1695170346 learned_addr learned my addr 172.21.15.31:0/1695170346 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:16.813 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.813+0000 7f4df7e00640 1 --2- 172.21.15.31:0/1695170346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80b21f0 0x7f4df80b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.813 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.813+0000 7f4df6a00640 1 -- 172.21.15.31:0/1695170346 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117355459 0 0) 0x7f4df80b2c70 con 0x7f4df8145240 2024-03-23T23:56:16.813 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.813+0000 7f4df6a00640 1 -- 172.21.15.31:0/1695170346 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ddc003520 con 0x7f4df8145240 2024-03-23T23:56:16.814 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.813+0000 7f4df7e00640 1 -- 172.21.15.31:0/1695170346 >> v1:172.21.15.59:6789/0 conn(0x7f4df813efd0 legacy=0x7f4df813f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:16.814 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.813+0000 7f4df7e00640 1 -- 172.21.15.31:0/1695170346 >> v1:172.21.15.31:6789/0 conn(0x7f4df8145240 legacy=0x7f4df8145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:16.814 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.813+0000 7f4df7e00640 1 -- 172.21.15.31:0/1695170346 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80b5e90 con 0x7f4df80b21f0 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.814+0000 7f4df7e00640 1 --2- 172.21.15.31:0/1695170346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80b21f0 0x7f4df80b25d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4de80097d0 tx=0x7f4de802b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec771da14ec377c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4df6a00640 1 -- 172.21.15.31:0/1695170346 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8031770 con 0x7f4df80b21f0 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4df6a00640 1 -- 172.21.15.31:0/1695170346 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8037070 con 0x7f4df80b21f0 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4df6a00640 1 -- 172.21.15.31:0/1695170346 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8031b10 con 0x7f4df80b21f0 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4dfea00640 1 -- 172.21.15.31:0/1695170346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80b21f0 msgr2=0x7f4df80b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4dfea00640 1 --2- 172.21.15.31:0/1695170346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80b21f0 0x7f4df80b25d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4de80097d0 tx=0x7f4de802b810 comp rx=0 tx=0).stop 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4dfea00640 1 -- 172.21.15.31:0/1695170346 shutdown_connections 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4dfea00640 1 --2- 172.21.15.31:0/1695170346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80b21f0 0x7f4df80b25d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:16.815 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4dfea00640 1 -- 172.21.15.31:0/1695170346 >> 172.21.15.31:0/1695170346 conn(0x7f4df80b5370 msgr2=0x7f4df80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:16.816 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4dfea00640 1 -- 172.21.15.31:0/1695170346 shutdown_connections 2024-03-23T23:56:16.816 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.815+0000 7f4dfea00640 1 -- 172.21.15.31:0/1695170346 wait complete. 2024-03-23T23:56:16.816 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 Processor -- start 2024-03-23T23:56:16.816 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 -- start start 2024-03-23T23:56:16.818 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80b21f0 0x7f4df80b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.818 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df813efd0 0x7f4df8137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df8145240 0x7f4df813b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8150c70 con 0x7f4df80b21f0 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8150af0 con 0x7f4df8145240 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.817+0000 7f4dfea00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8150df0 con 0x7f4df813efd0 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80b21f0 0x7f4df80b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80b21f0 0x7f4df80b7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57878/0 (socket says 172.21.15.31:57878) 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 -- 172.21.15.31:0/1879695648 learned_addr learned my addr 172.21.15.31:0/1879695648 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4dfca00640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df8145240 0x7f4df813b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7400640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df813efd0 0x7f4df8137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 -- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df813efd0 msgr2=0x7f4df8137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df813efd0 0x7f4df8137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 -- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df8145240 msgr2=0x7f4df813b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:16.819 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df8145240 0x7f4df813b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 -- 172.21.15.31:0/1879695648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df81357d0 con 0x7f4df80b21f0 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7400640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df813efd0 0x7f4df8137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.818+0000 7f4df7e00640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80b21f0 0x7f4df80b7930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4de8034040 tx=0x7f4de80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.819+0000 7f4defe00640 1 -- 172.21.15.31:0/1879695648 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8031570 con 0x7f4df80b21f0 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.819+0000 7f4defe00640 1 -- 172.21.15.31:0/1879695648 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8031710 con 0x7f4df80b21f0 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.819+0000 7f4defe00640 1 -- 172.21.15.31:0/1879695648 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8031b00 con 0x7f4df80b21f0 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.819+0000 7f4dfea00640 1 -- 172.21.15.31:0/1879695648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df8137250 con 0x7f4df80b21f0 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.819+0000 7f4dfea00640 1 -- 172.21.15.31:0/1879695648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df8136030 con 0x7f4df80b21f0 2024-03-23T23:56:16.820 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.820+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df8075260 con 0x7f4df80b21f0 2024-03-23T23:56:16.821 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.821+0000 7f4defe00640 1 -- 172.21.15.31:0/1879695648 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 90080+0+0 (secure 0 0 0) 0x7f4de8031070 con 0x7f4df80b21f0 2024-03-23T23:56:16.821 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.821+0000 7f4defe00640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4dd806bb40 0x7f4dd806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:16.821 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.821+0000 7f4defe00640 1 -- 172.21.15.31:0/1879695648 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f4de80abdf0 con 0x7f4df80b21f0 2024-03-23T23:56:16.821 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.822+0000 7f4df7400640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4dd806bb40 0x7f4dd806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:16.822 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.822+0000 7f4df7400640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4dd806bb40 0x7f4dd806e000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4df8150850 tx=0x7f4de4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:16.826 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:16.827+0000 7f4defe00640 1 -- 172.21.15.31:0/1879695648 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4de807b740 con 0x7f4df80b21f0 2024-03-23T23:56:17.019 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.019+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4df8135b20 con 0x7f4df80b21f0 2024-03-23T23:56:17.020 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.020+0000 7f4defe00640 1 -- 172.21.15.31:0/1879695648 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f4de807ef50 con 0x7f4df80b21f0 2024-03-23T23:56:17.020 INFO:teuthology.misc.health.smithi031.stdout: 2024-03-23T23:56:17.020 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":12,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:14.338166+0000","last_up_change":"0.000000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.022+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4dd806bb40 msgr2=0x7f4dd806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.022+0000 7f4ded600640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4dd806bb40 0x7f4dd806e000 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4df8150850 tx=0x7f4de4009040 comp rx=0 tx=0).stop 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80b21f0 msgr2=0x7f4df80b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80b21f0 0x7f4df80b7930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4de8034040 tx=0x7f4de80046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 shutdown_connections 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4dd806bb40 0x7f4dd806e000 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df8145240 0x7f4df813b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.023 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df813efd0 0x7f4df8137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.024 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 --2- 172.21.15.31:0/1879695648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4df80b21f0 0x7f4df80b7930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:17.024 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 >> 172.21.15.31:0/1879695648 conn(0x7f4df80b5370 msgr2=0x7f4df80b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:17.024 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 shutdown_connections 2024-03-23T23:56:17.024 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:17.023+0000 7f4ded600640 1 -- 172.21.15.31:0/1879695648 wait complete. 2024-03-23T23:56:17.036 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-23T23:56:23.842 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:24.043 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.043+0000 7fe15b200640 1 Processor -- start 2024-03-23T23:56:24.043 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.043+0000 7fe15b200640 1 -- start start 2024-03-23T23:56:24.044 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.044+0000 7fe15b200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0b5ae0 0x7fe15c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.044+0000 7fe15b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe15c0ae390 0x7fe15c14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.044+0000 7fe15b200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0b5ec0 con 0x7fe15c0b1610 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.044+0000 7fe15b200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0ae890 con 0x7fe15c0ae390 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.044+0000 7fe15b200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0b48a0 con 0x7fe15c0b5ae0 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe15a800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe15c0b1610 0x7fe15c0b3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54822/0 (socket says 172.21.15.31:54822) 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe15a800640 1 -- 172.21.15.31:0/1090643887 learned_addr learned my addr 172.21.15.31:0/1090643887 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe159400640 1 --2- 172.21.15.31:0/1090643887 >> v2:172.21.15.59:3300/0 conn(0x7fe15c0ae390 0x7fe15c14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.045 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe159e00640 1 --2- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0b5ae0 0x7fe15c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.046 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe158a00640 1 -- 172.21.15.31:0/1090643887 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083077841 0 0) 0x7fe15c0b5ec0 con 0x7fe15c0b1610 2024-03-23T23:56:24.046 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe158a00640 1 -- 172.21.15.31:0/1090643887 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe140003520 con 0x7fe15c0b1610 2024-03-23T23:56:24.046 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe159400640 1 -- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0b5ae0 msgr2=0x7fe15c0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:24.046 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe159400640 1 --2- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0b5ae0 0x7fe15c0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.046 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe159400640 1 -- 172.21.15.31:0/1090643887 >> v1:172.21.15.31:6789/0 conn(0x7fe15c0b1610 legacy=0x7fe15c0b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.046 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.045+0000 7fe159400640 1 -- 172.21.15.31:0/1090643887 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0b4dc0 con 0x7fe15c0ae390 2024-03-23T23:56:24.047 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.047+0000 7fe159400640 1 --2- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0ae390 0x7fe15c14a7d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1440097a0 tx=0x7fe14402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e592f30c912b35 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:24.047 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe158a00640 1 -- 172.21.15.31:0/1090643887 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1440315a0 con 0x7fe15c0ae390 2024-03-23T23:56:24.047 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe158a00640 1 -- 172.21.15.31:0/1090643887 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144037070 con 0x7fe15c0ae390 2024-03-23T23:56:24.047 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe158a00640 1 -- 172.21.15.31:0/1090643887 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144031940 con 0x7fe15c0ae390 2024-03-23T23:56:24.048 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe15b200640 1 -- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0ae390 msgr2=0x7fe15c14a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.048 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe15b200640 1 --2- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0ae390 0x7fe15c14a7d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1440097a0 tx=0x7fe14402b840 comp rx=0 tx=0).stop 2024-03-23T23:56:24.048 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe15b200640 1 -- 172.21.15.31:0/1090643887 shutdown_connections 2024-03-23T23:56:24.048 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe15b200640 1 --2- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0ae390 0x7fe15c14a7d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.049 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe15b200640 1 --2- 172.21.15.31:0/1090643887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0b5ae0 0x7fe15c0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.049 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.048+0000 7fe15b200640 1 -- 172.21.15.31:0/1090643887 >> 172.21.15.31:0/1090643887 conn(0x7fe15c0b8c90 msgr2=0x7fe15c0b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:24.049 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.049+0000 7fe15b200640 1 -- 172.21.15.31:0/1090643887 shutdown_connections 2024-03-23T23:56:24.049 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.049+0000 7fe15b200640 1 -- 172.21.15.31:0/1090643887 wait complete. 2024-03-23T23:56:24.050 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.051+0000 7fe15b200640 1 Processor -- start 2024-03-23T23:56:24.051 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.051+0000 7fe15b200640 1 -- start start 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe15b200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0ae390 0x7fe15c1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe15b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe15c0b1610 0x7fe15c1dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe15b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0b5ae0 0x7fe15c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe15b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0af000 con 0x7fe15c0b1610 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe15b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0aee80 con 0x7fe15c0b5ae0 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe15b200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0b1aa0 con 0x7fe15c0ae390 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe159400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe15c0b1610 0x7fe15c1dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.052 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe159400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe15c0b1610 0x7fe15c1dfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57882/0 (socket says 172.21.15.31:57882) 2024-03-23T23:56:24.053 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.052+0000 7fe159400640 1 -- 172.21.15.31:0/697974863 learned_addr learned my addr 172.21.15.31:0/697974863 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe15a800640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0b5ae0 0x7fe15c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe159e00640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0ae390 0x7fe15c1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe159400640 1 -- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0ae390 msgr2=0x7fe15c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe159400640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0ae390 0x7fe15c1461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe159400640 1 -- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0b5ae0 msgr2=0x7fe15c1438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe159400640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0b5ae0 0x7fe15c1438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe159400640 1 -- 172.21.15.31:0/697974863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c122a50 con 0x7fe15c0b1610 2024-03-23T23:56:24.054 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe159400640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe15c0b1610 0x7fe15c1dfa50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe14402be50 tx=0x7fe1440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:24.055 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.053+0000 7fe152000640 1 -- 172.21.15.31:0/697974863 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144006e10 con 0x7fe15c0b1610 2024-03-23T23:56:24.055 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.054+0000 7fe152000640 1 -- 172.21.15.31:0/697974863 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1440317a0 con 0x7fe15c0b1610 2024-03-23T23:56:24.055 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.054+0000 7fe152000640 1 -- 172.21.15.31:0/697974863 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144031b70 con 0x7fe15c0b1610 2024-03-23T23:56:24.055 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.054+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c122d30 con 0x7fe15c0b1610 2024-03-23T23:56:24.055 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.054+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c070f60 con 0x7fe15c0b1610 2024-03-23T23:56:24.055 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.055+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c04f400 con 0x7fe15c0b1610 2024-03-23T23:56:24.056 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.056+0000 7fe152000640 1 -- 172.21.15.31:0/697974863 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe144031d10 con 0x7fe15c0b1610 2024-03-23T23:56:24.056 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.057+0000 7fe152000640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13806bc00 0x7fe13806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.056 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.057+0000 7fe152000640 1 -- 172.21.15.31:0/697974863 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe14402f020 con 0x7fe15c0b1610 2024-03-23T23:56:24.057 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.057+0000 7fe159e00640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13806bc00 0x7fe13806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.058 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.058+0000 7fe159e00640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13806bc00 0x7fe13806e0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe14c007380 tx=0x7fe14c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:24.063 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.063+0000 7fe152000640 1 -- 172.21.15.31:0/697974863 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe14407b740 con 0x7fe15c0b1610 2024-03-23T23:56:24.277 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.277+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe15c0b6ba0 con 0x7fe15c0b1610 2024-03-23T23:56:24.543 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.543+0000 7fe152000640 1 -- 172.21.15.31:0/697974863 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12812 (secure 0 0 0) 0x7fe14407b040 con 0x7fe15c0b1610 2024-03-23T23:56:24.544 INFO:teuthology.misc.health.smithi031.stdout: 2024-03-23T23:56:24.544 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":17,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:21.695602+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13806bc00 msgr2=0x7fe13806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13806bc00 0x7fe13806e0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe14c007380 tx=0x7fe14c00b040 comp rx=0 tx=0).stop 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe15c0b1610 msgr2=0x7fe15c1dfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe15c0b1610 0x7fe15c1dfa50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe14402be50 tx=0x7fe1440046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 shutdown_connections 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13806bc00 0x7fe13806e0c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe15c0b5ae0 0x7fe15c1438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe15c0b1610 0x7fe15c1dfa50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.547 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 --2- 172.21.15.31:0/697974863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe15c0ae390 0x7fe15c1461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.548 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 >> 172.21.15.31:0/697974863 conn(0x7fe15c0b8c90 msgr2=0x7fe15c0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:24.548 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 shutdown_connections 2024-03-23T23:56:24.548 INFO:teuthology.misc.health.smithi031.stderr:2024-03-23T23:56:24.547+0000 7fe15b200640 1 -- 172.21.15.31:0/697974863 wait complete. 2024-03-23T23:56:24.563 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-23T23:56:24.563 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-23T23:56:24.564 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-23T23:56:24.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-23T23:56:24.571 INFO:tasks.ceph.mds.a:Started 2024-03-23T23:56:24.571 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-23T23:56:24.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-23T23:56:24.578 INFO:tasks.ceph.mds.b:Started 2024-03-23T23:56:24.579 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-23T23:56:24.579 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:24.736 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-03-23T23:56:24.748 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2024-03-23T23:56:24.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.774+0000 7f5b9ca00640 1 Processor -- start 2024-03-23T23:56:24.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.774+0000 7f5b9ca00640 1 -- start start 2024-03-23T23:56:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b9ca00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5b980b58f0 0x7f5b98148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b9ca00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980727e0 0x7f5b9814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b9ca00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b980b46d0 con 0x7f5b980b5510 2024-03-23T23:56:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b9ca00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9806f420 con 0x7f5b980b58f0 2024-03-23T23:56:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b9ca00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980b49b0 con 0x7f5b980727e0 2024-03-23T23:56:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b95e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5b980b5510 0x7f5b98071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55920/0 (socket says 172.21.15.31:55920) 2024-03-23T23:56:24.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b95e00640 1 -- 172.21.15.31:0/583162796 learned_addr learned my addr 172.21.15.31:0/583162796 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b96800640 1 --2- 172.21.15.31:0/583162796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980727e0 0x7f5b9814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.775+0000 7f5b95400640 1 --2- 172.21.15.31:0/583162796 >> v2:172.21.15.31:3300/0 conn(0x7f5b980b58f0 0x7f5b98148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.776+0000 7f5b96800640 1 -- 172.21.15.31:0/583162796 >> v2:172.21.15.31:3300/0 conn(0x7f5b980b58f0 msgr2=0x7f5b98148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.776+0000 7f5b96800640 1 --2- 172.21.15.31:0/583162796 >> v2:172.21.15.31:3300/0 conn(0x7f5b980b58f0 0x7f5b98148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.776+0000 7f5b96800640 1 -- 172.21.15.31:0/583162796 >> v1:172.21.15.31:6789/0 conn(0x7f5b980b5510 legacy=0x7f5b98071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.776+0000 7f5b94a00640 1 -- 172.21.15.31:0/583162796 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832868253 0 0) 0x7f5b980b46d0 con 0x7f5b980b5510 2024-03-23T23:56:24.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.776+0000 7f5b96800640 1 -- 172.21.15.31:0/583162796 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b980b2620 con 0x7f5b980727e0 2024-03-23T23:56:24.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.777+0000 7f5b96800640 1 --2- 172.21.15.31:0/583162796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980727e0 0x7f5b9814fb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009d90 tx=0x7f5b9002bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66c8a826643eb99 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.777+0000 7f5b94a00640 1 -- 172.21.15.31:0/583162796 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90039070 con 0x7f5b980727e0 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.777+0000 7f5b94a00640 1 -- 172.21.15.31:0/583162796 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9002cb30 con 0x7f5b980727e0 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.777+0000 7f5b94a00640 1 -- 172.21.15.31:0/583162796 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90034440 con 0x7f5b980727e0 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 -- 172.21.15.31:0/583162796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980727e0 msgr2=0x7f5b9814fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/583162796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980727e0 0x7f5b9814fb80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009d90 tx=0x7f5b9002bd80 comp rx=0 tx=0).stop 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 -- 172.21.15.31:0/583162796 shutdown_connections 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/583162796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980727e0 0x7f5b9814fb80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/583162796 >> v2:172.21.15.31:3300/0 conn(0x7f5b980b58f0 0x7f5b98148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 -- 172.21.15.31:0/583162796 >> 172.21.15.31:0/583162796 conn(0x7f5b98066fe0 msgr2=0x7f5b980673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 -- 172.21.15.31:0/583162796 shutdown_connections 2024-03-23T23:56:24.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.778+0000 7f5b9ca00640 1 -- 172.21.15.31:0/583162796 wait complete. 2024-03-23T23:56:24.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.780+0000 7f5b9ca00640 1 Processor -- start 2024-03-23T23:56:24.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.780+0000 7f5b9ca00640 1 -- start start 2024-03-23T23:56:24.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.780+0000 7f5b9ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b980727e0 0x7f5b981dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.780+0000 7f5b9ca00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980b5510 0x7f5b981e0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b9ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b980b58f0 0x7f5b98142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b9ca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980b5050 con 0x7f5b980727e0 2024-03-23T23:56:24.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b9ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b980b4ed0 con 0x7f5b980b58f0 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b9ca00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9806ee70 con 0x7f5b980b5510 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b980727e0 0x7f5b981dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b980727e0 0x7f5b981dfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44146/0 (socket says 172.21.15.31:44146) 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 -- 172.21.15.31:0/3881970140 learned_addr learned my addr 172.21.15.31:0/3881970140 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95400640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980b5510 0x7f5b981e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b96800640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b980b58f0 0x7f5b98142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 -- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980b5510 msgr2=0x7f5b981e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980b5510 0x7f5b981e0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 -- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b980b58f0 msgr2=0x7f5b98142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b980b58f0 0x7f5b98142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:24.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.781+0000 7f5b95e00640 1 -- 172.21.15.31:0/3881970140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b980b1cc0 con 0x7f5b980727e0 2024-03-23T23:56:24.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.782+0000 7f5b95e00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b980727e0 0x7f5b981dfff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c4a0 tx=0x7f5b8800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:24.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.782+0000 7f5b8e000640 1 -- 172.21.15.31:0/3881970140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88018070 con 0x7f5b980727e0 2024-03-23T23:56:24.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.782+0000 7f5b8e000640 1 -- 172.21.15.31:0/3881970140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b880074e0 con 0x7f5b980727e0 2024-03-23T23:56:24.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.782+0000 7f5b8e000640 1 -- 172.21.15.31:0/3881970140 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88004a20 con 0x7f5b980727e0 2024-03-23T23:56:24.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.782+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b980afd70 con 0x7f5b980727e0 2024-03-23T23:56:24.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.782+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b980af550 con 0x7f5b980727e0 2024-03-23T23:56:24.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.783+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9804f400 con 0x7f5b980727e0 2024-03-23T23:56:24.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.785+0000 7f5b8e000640 1 -- 172.21.15.31:0/3881970140 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5b88004bc0 con 0x7f5b980727e0 2024-03-23T23:56:24.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.785+0000 7f5b8e000640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5b7806bbd0 0x7f5b7806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:24.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.786+0000 7f5b8e000640 1 -- 172.21.15.31:0/3881970140 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b88089a20 con 0x7f5b980727e0 2024-03-23T23:56:24.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.786+0000 7f5b95400640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5b7806bbd0 0x7f5b7806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:24.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.787+0000 7f5b95400640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5b7806bbd0 0x7f5b7806e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b980b12b0 tx=0x7f5b84009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:24.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.791+0000 7f5b8e000640 1 -- 172.21.15.31:0/3881970140 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f5b88058200 con 0x7f5b980727e0 2024-03-23T23:56:24.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:24.998+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b980b0290 con 0x7f5b980727e0 2024-03-23T23:56:25.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.000+0000 7f5b8e000640 1 -- 172.21.15.31:0/3881970140 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12812 (secure 0 0 0) 0x7f5b8805c2a0 con 0x7f5b980727e0 2024-03-23T23:56:25.000 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:25.000 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:21.695602+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:25.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5b7806bbd0 msgr2=0x7f5b7806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5b7806bbd0 0x7f5b7806e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b980b12b0 tx=0x7f5b84009190 comp rx=0 tx=0).stop 2024-03-23T23:56:25.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b980727e0 msgr2=0x7f5b981dfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b980727e0 0x7f5b981dfff0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c4a0 tx=0x7f5b8800c960 comp rx=0 tx=0).stop 2024-03-23T23:56:25.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 shutdown_connections 2024-03-23T23:56:25.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5b7806bbd0 0x7f5b7806e090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b980b58f0 0x7f5b98142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b980b5510 0x7f5b981e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 --2- 172.21.15.31:0/3881970140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5b980727e0 0x7f5b981dfff0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 >> 172.21.15.31:0/3881970140 conn(0x7f5b98066fe0 msgr2=0x7f5b98071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:25.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 shutdown_connections 2024-03-23T23:56:25.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.003+0000 7f5b9ca00640 1 -- 172.21.15.31:0/3881970140 wait complete. 2024-03-23T23:56:25.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:56:19.394330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:56:25.025 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:56:25.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.248+0000 7fcf7d800640 1 Processor -- start 2024-03-23T23:56:25.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.249+0000 7fcf7d800640 1 -- start start 2024-03-23T23:56:25.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf7d800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf7806cb70 0x7fcf78140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf7d800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7806d3b0 con 0x7fcf7806da60 2024-03-23T23:56:25.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf7d800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf78072460 con 0x7fcf7806de40 2024-03-23T23:56:25.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf7d800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf78072230 con 0x7fcf7806cb70 2024-03-23T23:56:25.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf77400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf7806cb70 0x7fcf78140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf77400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf7806cb70 0x7fcf78140f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44150/0 (socket says 172.21.15.31:44150) 2024-03-23T23:56:25.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf77e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcf7806da60 0x7fcf7806c460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55926/0 (socket says 172.21.15.31:55926) 2024-03-23T23:56:25.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.250+0000 7fcf77400640 1 -- 172.21.15.31:0/592853005 learned_addr learned my addr 172.21.15.31:0/592853005 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:25.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.251+0000 7fcf77400640 1 -- 172.21.15.31:0/592853005 >> v1:172.21.15.59:6789/0 conn(0x7fcf7806de40 legacy=0x7fcf78151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:25.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.251+0000 7fcf77400640 1 -- 172.21.15.31:0/592853005 >> v1:172.21.15.31:6789/0 conn(0x7fcf7806da60 legacy=0x7fcf7806c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.251+0000 7fcf77400640 1 -- 172.21.15.31:0/592853005 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78072740 con 0x7fcf7806cb70 2024-03-23T23:56:25.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.252+0000 7fcf77400640 1 --2- 172.21.15.31:0/592853005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806cb70 0x7fcf78140f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618378f176e5f4ee server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:25.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.252+0000 7fcf76a00640 1 -- 172.21.15.31:0/592853005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60034070 con 0x7fcf7806cb70 2024-03-23T23:56:25.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.252+0000 7fcf76a00640 1 -- 172.21.15.31:0/592853005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60030860 con 0x7fcf7806cb70 2024-03-23T23:56:25.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.252+0000 7fcf76a00640 1 -- 172.21.15.31:0/592853005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60030c30 con 0x7fcf7806cb70 2024-03-23T23:56:25.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.253+0000 7fcf7d800640 1 -- 172.21.15.31:0/592853005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806cb70 msgr2=0x7fcf78140f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.253+0000 7fcf7d800640 1 --2- 172.21.15.31:0/592853005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806cb70 0x7fcf78140f60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf6002b9a0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.253+0000 7fcf7d800640 1 -- 172.21.15.31:0/592853005 shutdown_connections 2024-03-23T23:56:25.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.253+0000 7fcf7d800640 1 --2- 172.21.15.31:0/592853005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806cb70 0x7fcf78140f60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.253+0000 7fcf7d800640 1 -- 172.21.15.31:0/592853005 >> 172.21.15.31:0/592853005 conn(0x7fcf780676e0 msgr2=0x7fcf780ba900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:25.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.253+0000 7fcf7d800640 1 -- 172.21.15.31:0/592853005 shutdown_connections 2024-03-23T23:56:25.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.253+0000 7fcf7d800640 1 -- 172.21.15.31:0/592853005 wait complete. 2024-03-23T23:56:25.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.255+0000 7fcf7d800640 1 Processor -- start 2024-03-23T23:56:25.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.255+0000 7fcf7d800640 1 -- start start 2024-03-23T23:56:25.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf7d800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7806cb70 0x7fcf780b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf7d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806da60 0x7fcf781dced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf7d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7806de40 0x7fcf781dd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf7d800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7806d130 con 0x7fcf7806da60 2024-03-23T23:56:25.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf7d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7806cfb0 con 0x7fcf7806de40 2024-03-23T23:56:25.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf7d800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78073530 con 0x7fcf7806cb70 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806da60 0x7fcf781dced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806da60 0x7fcf781dced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44152/0 (socket says 172.21.15.31:44152) 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 -- 172.21.15.31:0/598813227 learned_addr learned my addr 172.21.15.31:0/598813227 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 -- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7806cb70 msgr2=0x7fcf780b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7806cb70 0x7fcf780b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 -- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7806de40 msgr2=0x7fcf781dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7806de40 0x7fcf781dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.256+0000 7fcf77400640 1 -- 172.21.15.31:0/598813227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780b2f60 con 0x7fcf7806da60 2024-03-23T23:56:25.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.257+0000 7fcf77400640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806da60 0x7fcf781dced0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:25.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.257+0000 7fcf6fe00640 1 -- 172.21.15.31:0/598813227 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60048070 con 0x7fcf7806da60 2024-03-23T23:56:25.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.257+0000 7fcf6fe00640 1 -- 172.21.15.31:0/598813227 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60039d90 con 0x7fcf7806da60 2024-03-23T23:56:25.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.257+0000 7fcf6fe00640 1 -- 172.21.15.31:0/598813227 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf60034040 con 0x7fcf7806da60 2024-03-23T23:56:25.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.257+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf780b31d0 con 0x7fcf7806da60 2024-03-23T23:56:25.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.257+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf780b1ec0 con 0x7fcf7806da60 2024-03-23T23:56:25.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.258+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf780752c0 con 0x7fcf7806da60 2024-03-23T23:56:25.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.259+0000 7fcf6fe00640 1 -- 172.21.15.31:0/598813227 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcf6004b070 con 0x7fcf7806da60 2024-03-23T23:56:25.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.260+0000 7fcf6fe00640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5406bbd0 0x7fcf5406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.260+0000 7fcf6fe00640 1 -- 172.21.15.31:0/598813227 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcf600ac8b0 con 0x7fcf7806da60 2024-03-23T23:56:25.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.261+0000 7fcf77e00640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5406bbd0 0x7fcf5406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.262+0000 7fcf77e00640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5406bbd0 0x7fcf5406e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf68007fd0 tx=0x7fcf68007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:25.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.266+0000 7fcf6fe00640 1 -- 172.21.15.31:0/598813227 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fcf6007b6e0 con 0x7fcf7806da60 2024-03-23T23:56:25.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.465+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf780b4d30 con 0x7fcf7806da60 2024-03-23T23:56:25.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.466+0000 7fcf6fe00640 1 -- 172.21.15.31:0/598813227 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf6007afe0 con 0x7fcf7806da60 2024-03-23T23:56:25.466 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-03-23T23:56:25.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5406bbd0 msgr2=0x7fcf5406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5406bbd0 0x7fcf5406e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcf68007fd0 tx=0x7fcf68007d80 comp rx=0 tx=0).stop 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806da60 msgr2=0x7fcf781dced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806da60 0x7fcf781dced0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009870 tx=0x7fcf60004730 comp rx=0 tx=0).stop 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 shutdown_connections 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5406bbd0 0x7fcf5406e090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7806de40 0x7fcf781dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7806da60 0x7fcf781dced0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 --2- 172.21.15.31:0/598813227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7806cb70 0x7fcf780b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.468+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 >> 172.21.15.31:0/598813227 conn(0x7fcf780676e0 msgr2=0x7fcf78140d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.469+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 shutdown_connections 2024-03-23T23:56:25.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.469+0000 7fcf7d800640 1 -- 172.21.15.31:0/598813227 wait complete. 2024-03-23T23:56:25.487 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:56:25.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.711+0000 7f2836400640 1 Processor -- start 2024-03-23T23:56:25.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.711+0000 7f2836400640 1 -- start start 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f2836400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f283006b6e0 0x7f2830141400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f2836400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 0x7f2830151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f2836400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283006c020 con 0x7f283006b300 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f2836400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283006bdd0 con 0x7f283006b6e0 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f2836400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2830072770 con 0x7f2830141940 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f282ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f283006b6e0 0x7f2830141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f282ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f283006b6e0 0x7f2830141400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44160/0 (socket says 172.21.15.31:44160) 2024-03-23T23:56:25.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f282ea00640 1 -- 172.21.15.31:0/2966543417 learned_addr learned my addr 172.21.15.31:0/2966543417 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:25.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f282f400640 1 --1- 172.21.15.31:0/2966543417 >> v1:172.21.15.31:6789/0 conn(0x7f283006b300 0x7f2830071780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55936/0 (socket says 172.21.15.31:55936) 2024-03-23T23:56:25.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.713+0000 7f282ea00640 1 -- 172.21.15.31:0/2966543417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 msgr2=0x7f2830151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:25.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.714+0000 7f282ea00640 1 --2- 172.21.15.31:0/2966543417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 0x7f2830151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.714+0000 7f282ea00640 1 -- 172.21.15.31:0/2966543417 >> v1:172.21.15.31:6789/0 conn(0x7f283006b300 legacy=0x7f2830071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.714+0000 7f282ea00640 1 -- 172.21.15.31:0/2966543417 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830071010 con 0x7f283006b6e0 2024-03-23T23:56:25.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.715+0000 7f282ea00640 1 --2- 172.21.15.31:0/2966543417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b6e0 0x7f2830141400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f281c009870 tx=0x7f281c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295336c18716585 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.715+0000 7f282e000640 1 -- 172.21.15.31:0/2966543417 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c0317c0 con 0x7f283006b6e0 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.715+0000 7f282e000640 1 -- 172.21.15.31:0/2966543417 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c037070 con 0x7f283006b6e0 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.715+0000 7f282e000640 1 -- 172.21.15.31:0/2966543417 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c031b80 con 0x7f283006b6e0 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 -- 172.21.15.31:0/2966543417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b6e0 msgr2=0x7f2830141400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 --2- 172.21.15.31:0/2966543417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b6e0 0x7f2830141400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f281c009870 tx=0x7f281c02b860 comp rx=0 tx=0).stop 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 -- 172.21.15.31:0/2966543417 shutdown_connections 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 --2- 172.21.15.31:0/2966543417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 0x7f2830151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 --2- 172.21.15.31:0/2966543417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b6e0 0x7f2830141400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 -- 172.21.15.31:0/2966543417 >> 172.21.15.31:0/2966543417 conn(0x7f28300b7770 msgr2=0x7f28300b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 -- 172.21.15.31:0/2966543417 shutdown_connections 2024-03-23T23:56:25.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.716+0000 7f2836400640 1 -- 172.21.15.31:0/2966543417 wait complete. 2024-03-23T23:56:25.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.717+0000 7f2836400640 1 Processor -- start 2024-03-23T23:56:25.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.718+0000 7f2836400640 1 -- start start 2024-03-23T23:56:25.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.718+0000 7f2836400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b300 0x7f2830138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.718+0000 7f2836400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f283006b6e0 0x7f2830146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.718+0000 7f2836400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 0x7f2830146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.718+0000 7f2836400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283006eb00 con 0x7f283006b300 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.718+0000 7f2836400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283006bb20 con 0x7f283006b6e0 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.718+0000 7f2836400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283006df20 con 0x7f2830141940 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b300 0x7f2830138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b300 0x7f2830138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44168/0 (socket says 172.21.15.31:44168) 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 -- 172.21.15.31:0/158398358 learned_addr learned my addr 172.21.15.31:0/158398358 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282fe00640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 0x7f2830146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282ea00640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f283006b6e0 0x7f2830146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 -- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 msgr2=0x7f2830146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 0x7f2830146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 -- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f283006b6e0 msgr2=0x7f2830146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f283006b6e0 0x7f2830146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 -- 172.21.15.31:0/158398358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830146190 con 0x7f283006b300 2024-03-23T23:56:25.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.719+0000 7f282f400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b300 0x7f2830138ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f282000c3c0 tx=0x7f282000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:25.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.720+0000 7f2827400640 1 -- 172.21.15.31:0/158398358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28200074e0 con 0x7f283006b300 2024-03-23T23:56:25.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.720+0000 7f2827400640 1 -- 172.21.15.31:0/158398358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820007680 con 0x7f283006b300 2024-03-23T23:56:25.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.720+0000 7f2827400640 1 -- 172.21.15.31:0/158398358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820004a00 con 0x7f283006b300 2024-03-23T23:56:25.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.720+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2830144ca0 con 0x7f283006b300 2024-03-23T23:56:25.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.720+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28300b5570 con 0x7f283006b300 2024-03-23T23:56:25.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.721+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2830146360 con 0x7f283006b300 2024-03-23T23:56:25.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.722+0000 7f2827400640 1 -- 172.21.15.31:0/158398358 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f282001a020 con 0x7f283006b300 2024-03-23T23:56:25.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.723+0000 7f2827400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f281006bbd0 0x7f281006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:25.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.723+0000 7f2827400640 1 -- 172.21.15.31:0/158398358 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2820089eb0 con 0x7f283006b300 2024-03-23T23:56:25.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.723+0000 7f282ea00640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f281006bbd0 0x7f281006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:25.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.725+0000 7f282ea00640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f281006bbd0 0x7f281006e090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f281c036000 tx=0x7f281c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:25.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.728+0000 7f2827400640 1 -- 172.21.15.31:0/158398358 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f2820058ce0 con 0x7f283006b300 2024-03-23T23:56:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.968+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2830140280 con 0x7f283006b300 2024-03-23T23:56:25.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.968+0000 7f2827400640 1 -- 172.21.15.31:0/158398358 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2111 (secure 0 0 0) 0x7f28200585e0 con 0x7f283006b300 2024-03-23T23:56:25.968 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:25.969 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/481677666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":481677666},{"type":"v1","addr":"172.21.15.31:6833","nonce":481677666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3774186650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3774186650},{"type":"v1","addr":"172.21.15.59:6835","nonce":3774186650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-23T23:56:25.969 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-03-23T23:56:25.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f281006bbd0 msgr2=0x7f281006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f281006bbd0 0x7f281006e090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f281c036000 tx=0x7f281c03d040 comp rx=0 tx=0).stop 2024-03-23T23:56:25.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b300 msgr2=0x7f2830138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:25.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b300 0x7f2830138ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f282000c3c0 tx=0x7f282000c880 comp rx=0 tx=0).stop 2024-03-23T23:56:25.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 shutdown_connections 2024-03-23T23:56:25.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f281006bbd0 0x7f281006e090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f283006b6e0 0x7f2830146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2830141940 0x7f2830146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 --2- 172.21.15.31:0/158398358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f283006b300 0x7f2830138ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:25.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 >> 172.21.15.31:0/158398358 conn(0x7f28300b7770 msgr2=0x7f283013ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:25.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 shutdown_connections 2024-03-23T23:56:25.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:25.971+0000 7f2836400640 1 -- 172.21.15.31:0/158398358 wait complete. 2024-03-23T23:56:25.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:26.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.213+0000 7f7373000640 1 Processor -- start 2024-03-23T23:56:26.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.214+0000 7f7373000640 1 -- start start 2024-03-23T23:56:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.215+0000 7f7373000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f736c0b5a70 0x7f736c145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.215+0000 7f7373000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 0x7f736c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.215+0000 7f7373000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c0b5e50 con 0x7f736c0b27e0 2024-03-23T23:56:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.215+0000 7f7373000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c06f360 con 0x7f736c0b5a70 2024-03-23T23:56:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.215+0000 7f7373000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c145890 con 0x7f736c06eeb0 2024-03-23T23:56:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.216+0000 7f736b400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f736c0b27e0 0x7f736c13f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55942/0 (socket says 172.21.15.31:55942) 2024-03-23T23:56:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.216+0000 7f736b400640 1 -- 172.21.15.31:0/1245583337 learned_addr learned my addr 172.21.15.31:0/1245583337 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.216+0000 7f736be00640 1 --2- 172.21.15.31:0/1245583337 >> v2:172.21.15.59:3300/0 conn(0x7f736c0b5a70 0x7f736c145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.216+0000 7f7371000640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 0x7f736c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.216+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232905538 0 0) 0x7f736c0b5e50 con 0x7f736c0b27e0 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.216+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7350003520 con 0x7f736c0b27e0 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2140229155 0 0) 0x7f7350003520 con 0x7f736c0b27e0 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 msgr2=0x7f736c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 0x7f736c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 >> v2:172.21.15.59:3300/0 conn(0x7f736c0b5a70 msgr2=0x7f736c145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 --2- 172.21.15.31:0/1245583337 >> v2:172.21.15.59:3300/0 conn(0x7f736c0b5a70 0x7f736c145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c145240 con 0x7f736c0b27e0 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f7358001670 con 0x7f736c0b27e0 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 >> v1:172.21.15.31:6789/0 conn(0x7f736c0b27e0 legacy=0x7f736c13f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73500039b0 0x7f7350003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 0x7f7350004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7350004d40 0x7f73500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c06f360 con 0x7f73500039b0 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c145890 con 0x7f7350004d40 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735000b9c0 con 0x7f736c06eeb0 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.217+0000 7f736be00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73500039b0 0x7f7350003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.218+0000 7f736b400640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 0x7f7350004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.218+0000 7f736be00640 1 -- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 msgr2=0x7f7350004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.218+0000 7f736be00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c06eeb0 0x7f7350004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.218+0000 7f736be00640 1 -- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7350004d40 msgr2=0x7f73500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.218+0000 7f736be00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7350004d40 0x7f73500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.218+0000 7f736be00640 1 -- 172.21.15.31:0/1245583337 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350003520 con 0x7f73500039b0 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.219+0000 7f736be00640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73500039b0 0x7f7350003dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f735c009fc0 tx=0x7f7350005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf97c4760ba475b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.219+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c039070 con 0x7f73500039b0 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.219+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c02cc60 con 0x7f73500039b0 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.219+0000 7f736aa00640 1 -- 172.21.15.31:0/1245583337 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c009c10 con 0x7f73500039b0 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.220+0000 7f7373000640 1 -- 172.21.15.31:0/1245583337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73500039b0 msgr2=0x7f7350003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.220+0000 7f7373000640 1 --2- 172.21.15.31:0/1245583337 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73500039b0 0x7f7350003dd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f735c009fc0 tx=0x7f7350005830 comp rx=0 tx=0).stop 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.220+0000 7f7371000640 1 -- 172.21.15.31:0/1245583337 reap_dead start 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.220+0000 7f7373000640 1 -- 172.21.15.31:0/1245583337 shutdown_connections 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.220+0000 7f7373000640 1 -- 172.21.15.31:0/1245583337 >> 172.21.15.31:0/1245583337 conn(0x7f736c066fb0 msgr2=0x7f736c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.220+0000 7f7373000640 1 -- 172.21.15.31:0/1245583337 shutdown_connections 2024-03-23T23:56:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.220+0000 7f7373000640 1 -- 172.21.15.31:0/1245583337 wait complete. 2024-03-23T23:56:26.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.221+0000 7f7373000640 1 Processor -- start 2024-03-23T23:56:26.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.222+0000 7f7373000640 1 -- start start 2024-03-23T23:56:26.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.222+0000 7f7373000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73500039b0 0x7f736c13a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.222+0000 7f7373000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c0b0b40 0x7f736c1e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.222+0000 7f7373000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f736c144d90 0x7f736c148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.222+0000 7f7373000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c13f890 con 0x7f736c144d90 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.222+0000 7f7373000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c13f710 con 0x7f73500039b0 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.222+0000 7f7373000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0708f0 con 0x7f736c0b0b40 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f736c144d90 0x7f736c148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f736c144d90 0x7f736c148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44174/0 (socket says 172.21.15.31:44174) 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 -- 172.21.15.31:0/350982602 learned_addr learned my addr 172.21.15.31:0/350982602 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f736be00640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73500039b0 0x7f736c13a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f736b400640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c0b0b40 0x7f736c1e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 -- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c0b0b40 msgr2=0x7f736c1e0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c0b0b40 0x7f736c1e0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 -- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73500039b0 msgr2=0x7f736c13a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73500039b0 0x7f736c13a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f7371000640 1 -- 172.21.15.31:0/350982602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0b0060 con 0x7f736c144d90 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.223+0000 7f736b400640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c0b0b40 0x7f736c1e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.224+0000 7f7371000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f736c144d90 0x7f736c148910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f736c06d5e0 tx=0x7f736400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.224+0000 7f7363e00640 1 -- 172.21.15.31:0/350982602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364017070 con 0x7f736c144d90 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.224+0000 7f7363e00640 1 -- 172.21.15.31:0/350982602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736400c620 con 0x7f736c144d90 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.224+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c0b0340 con 0x7f736c144d90 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.224+0000 7f7363e00640 1 -- 172.21.15.31:0/350982602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400ca10 con 0x7f736c144d90 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.224+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c1e10b0 con 0x7f736c144d90 2024-03-23T23:56:26.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.225+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c04f400 con 0x7f736c144d90 2024-03-23T23:56:26.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.226+0000 7f7363e00640 1 -- 172.21.15.31:0/350982602 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f736401a070 con 0x7f736c144d90 2024-03-23T23:56:26.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.227+0000 7f7363e00640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f734c06bbd0 0x7f734c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.227+0000 7f7363e00640 1 -- 172.21.15.31:0/350982602 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f736408a590 con 0x7f736c144d90 2024-03-23T23:56:26.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.228+0000 7f736be00640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f734c06bbd0 0x7f734c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.229+0000 7f736be00640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f734c06bbd0 0x7f734c06e090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f735c036000 tx=0x7f735c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:26.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.232+0000 7f7363e00640 1 -- 172.21.15.31:0/350982602 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f7364058d70 con 0x7f736c144d90 2024-03-23T23:56:26.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.432+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f736c0b34c0 con 0x7f736c144d90 2024-03-23T23:56:26.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.434+0000 7f7363e00640 1 -- 172.21.15.31:0/350982602 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12812 (secure 0 0 0) 0x7f736405ce10 con 0x7f736c144d90 2024-03-23T23:56:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:26.435 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:21.695602+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:26.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f734c06bbd0 msgr2=0x7f734c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f734c06bbd0 0x7f734c06e090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f735c036000 tx=0x7f735c02e000 comp rx=0 tx=0).stop 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f736c144d90 msgr2=0x7f736c148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f736c144d90 0x7f736c148910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f736c06d5e0 tx=0x7f736400ec00 comp rx=0 tx=0).stop 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 shutdown_connections 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f734c06bbd0 0x7f734c06e090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f736c144d90 0x7f736c148910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f736c0b0b40 0x7f736c1e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 --2- 172.21.15.31:0/350982602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73500039b0 0x7f736c13a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 >> 172.21.15.31:0/350982602 conn(0x7f736c066fb0 msgr2=0x7f736c13af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 shutdown_connections 2024-03-23T23:56:26.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.437+0000 7f7373000640 1 -- 172.21.15.31:0/350982602 wait complete. 2024-03-23T23:56:26.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:56:19.394330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:56:26.455 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:56:26.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.680+0000 7f903be00640 1 Processor -- start 2024-03-23T23:56:26.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.681+0000 7f903be00640 1 -- start start 2024-03-23T23:56:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.682+0000 7f903be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f903c0b51b0 0x7f903c14a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.682+0000 7f903be00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0b8d70 con 0x7f903c14ad80 2024-03-23T23:56:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.682+0000 7f903be00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0b9b00 con 0x7f903c0b6b30 2024-03-23T23:56:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.682+0000 7f903be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c0b8fe0 con 0x7f903c0b51b0 2024-03-23T23:56:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.682+0000 7f9033e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f903c14ad80 0x7f903c140e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55956/0 (socket says 172.21.15.31:55956) 2024-03-23T23:56:26.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.682+0000 7f9033e00640 1 -- 172.21.15.31:0/2226456290 learned_addr learned my addr 172.21.15.31:0/2226456290 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903aa00640 1 --2- 172.21.15.31:0/2226456290 >> v2:172.21.15.59:3300/0 conn(0x7f903c0b51b0 0x7f903c14a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726921790 0 0) 0x7f903c0b8d70 con 0x7f903c14ad80 2024-03-23T23:56:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020003520 con 0x7f903c14ad80 2024-03-23T23:56:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646573292 0 0) 0x7f9020003520 con 0x7f903c14ad80 2024-03-23T23:56:26.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 >> v2:172.21.15.59:3300/0 conn(0x7f903c0b51b0 msgr2=0x7f903c14a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 --2- 172.21.15.31:0/2226456290 >> v2:172.21.15.59:3300/0 conn(0x7f903c0b51b0 0x7f903c14a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 >> v1:172.21.15.59:6789/0 conn(0x7f903c0b6b30 legacy=0x7f903c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0b9fe0 con 0x7f903c14ad80 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f9024001670 con 0x7f903c14ad80 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 >> v1:172.21.15.31:6789/0 conn(0x7f903c14ad80 legacy=0x7f903c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90200039b0 0x7f9020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9020004800 0x7f9020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b8fe0 con 0x7f90200051c0 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.683+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902000c160 con 0x7f90200039b0 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902000c360 con 0x7f9020004800 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903b400640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903aa00640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90200039b0 0x7f9020003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f9033e00640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9020004800 0x7f9020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903b400640 1 -- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9020004800 msgr2=0x7f9020004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:26.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903b400640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9020004800 0x7f9020004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903b400640 1 -- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90200039b0 msgr2=0x7f9020003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:26.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903b400640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90200039b0 0x7f9020003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.684+0000 7f903b400640 1 -- 172.21.15.31:0/2226456290 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020003520 con 0x7f90200051c0 2024-03-23T23:56:26.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.685+0000 7f903b400640 1 -- 172.21.15.31:0/2226456290 reap_dead start 2024-03-23T23:56:26.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.685+0000 7f903b400640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9034001e50 tx=0x7f9020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714c3e72c400a2b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:26.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034001a70 con 0x7f90200051c0 2024-03-23T23:56:26.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9034003bb0 con 0x7f90200051c0 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903a000640 1 -- 172.21.15.31:0/2226456290 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340050d0 con 0x7f90200051c0 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903be00640 1 -- 172.21.15.31:0/2226456290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200051c0 msgr2=0x7f902000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903be00640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9034001e50 tx=0x7f9020005830 comp rx=0 tx=0).stop 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903be00640 1 -- 172.21.15.31:0/2226456290 shutdown_connections 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903be00640 1 --2- 172.21.15.31:0/2226456290 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f90200051c0 0x7f902000b9c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903be00640 1 -- 172.21.15.31:0/2226456290 >> 172.21.15.31:0/2226456290 conn(0x7f903c0671f0 msgr2=0x7f903c067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903be00640 1 -- 172.21.15.31:0/2226456290 shutdown_connections 2024-03-23T23:56:26.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.686+0000 7f903be00640 1 -- 172.21.15.31:0/2226456290 wait complete. 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.688+0000 7f903be00640 1 Processor -- start 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.688+0000 7f903be00640 1 -- start start 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f903be00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90200051c0 0x7f903c0bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f903be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f903c0bbc10 0x7f903c0ba870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f903be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903c0badb0 0x7f903c1e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f903be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b3dd0 con 0x7f903c0bbc10 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f903be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b6420 con 0x7f903c0badb0 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f903be00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0b3f50 con 0x7f90200051c0 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f9033e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f903c0bbc10 0x7f903c0ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f9033e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f903c0bbc10 0x7f903c0ba870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44190/0 (socket says 172.21.15.31:44190) 2024-03-23T23:56:26.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.689+0000 7f9033e00640 1 -- 172.21.15.31:0/242401135 learned_addr learned my addr 172.21.15.31:0/242401135 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f903aa00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90200051c0 0x7f903c0bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f903b400640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903c0badb0 0x7f903c1e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033e00640 1 -- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90200051c0 msgr2=0x7f903c0bd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033e00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90200051c0 0x7f903c0bd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033e00640 1 -- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903c0badb0 msgr2=0x7f903c1e0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033e00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903c0badb0 0x7f903c1e0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033e00640 1 -- 172.21.15.31:0/242401135 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c148000 con 0x7f903c0bbc10 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f903b400640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903c0badb0 0x7f903c1e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:26.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033e00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f903c0bbc10 0x7f903c0ba870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f902400e7b0 tx=0x7f902400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:26.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033400640 1 -- 172.21.15.31:0/242401135 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400c870 con 0x7f903c0bbc10 2024-03-23T23:56:26.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033400640 1 -- 172.21.15.31:0/242401135 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9024018070 con 0x7f903c0bbc10 2024-03-23T23:56:26.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f9033400640 1 -- 172.21.15.31:0/242401135 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400cc50 con 0x7f903c0bbc10 2024-03-23T23:56:26.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.690+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c0bc640 con 0x7f903c0bbc10 2024-03-23T23:56:26.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.691+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c0bd5f0 con 0x7f903c0bbc10 2024-03-23T23:56:26.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.692+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c14ab70 con 0x7f903c0bbc10 2024-03-23T23:56:26.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.693+0000 7f9033400640 1 -- 172.21.15.31:0/242401135 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f902401d460 con 0x7f903c0bbc10 2024-03-23T23:56:26.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.694+0000 7f9033400640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f901806bbd0 0x7f901806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:26.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.694+0000 7f9033400640 1 -- 172.21.15.31:0/242401135 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f902408a720 con 0x7f903c0bbc10 2024-03-23T23:56:26.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.694+0000 7f903aa00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f901806bbd0 0x7f901806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:26.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.695+0000 7f903aa00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f901806bbd0 0x7f901806e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f902c009990 tx=0x7f902c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:26.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.698+0000 7f9033400640 1 -- 172.21.15.31:0/242401135 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f903c14ab70 con 0x7f903c0bbc10 2024-03-23T23:56:26.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.906+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f903c0752c0 con 0x7f903c0bbc10 2024-03-23T23:56:26.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.907+0000 7f9033400640 1 -- 172.21.15.31:0/242401135 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90240594c0 con 0x7f903c0bbc10 2024-03-23T23:56:26.907 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.910+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f901806bbd0 msgr2=0x7f901806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.910+0000 7f903be00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f901806bbd0 0x7f901806e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f902c009990 tx=0x7f902c008040 comp rx=0 tx=0).stop 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.910+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f903c0bbc10 msgr2=0x7f903c0ba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.910+0000 7f903be00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f903c0bbc10 0x7f903c0ba870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f902400e7b0 tx=0x7f902400ec70 comp rx=0 tx=0).stop 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 shutdown_connections 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f901806bbd0 0x7f901806e090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903c0badb0 0x7f903c1e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f903c0bbc10 0x7f903c0ba870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 --2- 172.21.15.31:0/242401135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90200051c0 0x7f903c0bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:26.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 >> 172.21.15.31:0/242401135 conn(0x7f903c0671f0 msgr2=0x7f903c13f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:26.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 shutdown_connections 2024-03-23T23:56:26.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:26.911+0000 7f903be00640 1 -- 172.21.15.31:0/242401135 wait complete. 2024-03-23T23:56:26.929 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-23T23:56:27.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.150+0000 7efe7f200640 1 Processor -- start 2024-03-23T23:56:27.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.150+0000 7efe7f200640 1 -- start start 2024-03-23T23:56:27.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.151+0000 7efe7f200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe80072290 0x7efe800b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.151+0000 7efe7f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe800b7fa0 0x7efe800b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.151+0000 7efe7f200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe80144f20 0x7efe800b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7f200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8013f6e0 con 0x7efe80072290 2024-03-23T23:56:27.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7f200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe80072670 con 0x7efe80144f20 2024-03-23T23:56:27.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800b7080 con 0x7efe800b7fa0 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe80072290 0x7efe800b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe80072290 0x7efe800b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44194/0 (socket says 172.21.15.31:44194) 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 -- 172.21.15.31:0/159355767 learned_addr learned my addr 172.21.15.31:0/159355767 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7d400640 1 --2- 172.21.15.31:0/159355767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe800b7fa0 0x7efe800b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7e800640 1 --2- 172.21.15.31:0/159355767 >> v2:172.21.15.59:3300/0 conn(0x7efe80144f20 0x7efe800b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 -- 172.21.15.31:0/159355767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe800b7fa0 msgr2=0x7efe800b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 --2- 172.21.15.31:0/159355767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe800b7fa0 0x7efe800b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 -- 172.21.15.31:0/159355767 >> v2:172.21.15.59:3300/0 conn(0x7efe80144f20 msgr2=0x7efe800b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 --2- 172.21.15.31:0/159355767 >> v2:172.21.15.59:3300/0 conn(0x7efe80144f20 0x7efe800b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.152+0000 7efe7de00640 1 -- 172.21.15.31:0/159355767 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800b87e0 con 0x7efe80072290 2024-03-23T23:56:27.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.154+0000 7efe7de00640 1 --2- 172.21.15.31:0/159355767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe80072290 0x7efe800b6b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe800b9520 tx=0x7efe7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb5a155a813292e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.154+0000 7efe7ca00640 1 -- 172.21.15.31:0/159355767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7002e070 con 0x7efe80072290 2024-03-23T23:56:27.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.154+0000 7efe7ca00640 1 -- 172.21.15.31:0/159355767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70037070 con 0x7efe80072290 2024-03-23T23:56:27.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.154+0000 7efe7ca00640 1 -- 172.21.15.31:0/159355767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70031a00 con 0x7efe80072290 2024-03-23T23:56:27.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.154+0000 7efe7f200640 1 -- 172.21.15.31:0/159355767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe80072290 msgr2=0x7efe800b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.154+0000 7efe7f200640 1 --2- 172.21.15.31:0/159355767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe80072290 0x7efe800b6b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe800b9520 tx=0x7efe7002b880 comp rx=0 tx=0).stop 2024-03-23T23:56:27.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.155+0000 7efe7f200640 1 -- 172.21.15.31:0/159355767 shutdown_connections 2024-03-23T23:56:27.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.155+0000 7efe7f200640 1 --2- 172.21.15.31:0/159355767 >> v2:172.21.15.59:3300/0 conn(0x7efe80144f20 0x7efe800b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.155+0000 7efe7f200640 1 --2- 172.21.15.31:0/159355767 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe800b7fa0 0x7efe800b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.155+0000 7efe7f200640 1 --2- 172.21.15.31:0/159355767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe80072290 0x7efe800b6b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.155+0000 7efe7f200640 1 -- 172.21.15.31:0/159355767 >> 172.21.15.31:0/159355767 conn(0x7efe8006cb70 msgr2=0x7efe8006cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:27.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.155+0000 7efe7f200640 1 -- 172.21.15.31:0/159355767 shutdown_connections 2024-03-23T23:56:27.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.155+0000 7efe7f200640 1 -- 172.21.15.31:0/159355767 wait complete. 2024-03-23T23:56:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.156+0000 7efe7f200640 1 Processor -- start 2024-03-23T23:56:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.157+0000 7efe7f200640 1 -- start start 2024-03-23T23:56:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.157+0000 7efe7f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe80072290 0x7efe801cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.157+0000 7efe7f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe800b7fa0 0x7efe801cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.157+0000 7efe7f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe80144f20 0x7efe801ddab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.157+0000 7efe7f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800b3b40 con 0x7efe800b7fa0 2024-03-23T23:56:27.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.157+0000 7efe7f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800b39c0 con 0x7efe80144f20 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.157+0000 7efe7f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800b7510 con 0x7efe80072290 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe800b7fa0 0x7efe801cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe800b7fa0 0x7efe801cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44196/0 (socket says 172.21.15.31:44196) 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 -- 172.21.15.31:0/1862348814 learned_addr learned my addr 172.21.15.31:0/1862348814 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7de00640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe80072290 0x7efe801cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7e800640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe80144f20 0x7efe801ddab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 -- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe80072290 msgr2=0x7efe801cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe80072290 0x7efe801cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 -- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe80144f20 msgr2=0x7efe801ddab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe80144f20 0x7efe801ddab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 -- 172.21.15.31:0/1862348814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe801cdbc0 con 0x7efe800b7fa0 2024-03-23T23:56:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7e800640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe80144f20 0x7efe801ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:27.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.158+0000 7efe7d400640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe800b7fa0 0x7efe801cafc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe6800d800 tx=0x7efe6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.159+0000 7efe76000640 1 -- 172.21.15.31:0/1862348814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68018020 con 0x7efe800b7fa0 2024-03-23T23:56:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.159+0000 7efe76000640 1 -- 172.21.15.31:0/1862348814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe68009640 con 0x7efe800b7fa0 2024-03-23T23:56:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.159+0000 7efe76000640 1 -- 172.21.15.31:0/1862348814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68009a10 con 0x7efe800b7fa0 2024-03-23T23:56:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.159+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe801ce330 con 0x7efe800b7fa0 2024-03-23T23:56:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.159+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe801cdea0 con 0x7efe800b7fa0 2024-03-23T23:56:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.160+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe800752c0 con 0x7efe800b7fa0 2024-03-23T23:56:27.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.161+0000 7efe76000640 1 -- 172.21.15.31:0/1862348814 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efe6801b020 con 0x7efe800b7fa0 2024-03-23T23:56:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.162+0000 7efe76000640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7efe5c06bbd0 0x7efe5c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.162+0000 7efe76000640 1 -- 172.21.15.31:0/1862348814 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe6808a8d0 con 0x7efe800b7fa0 2024-03-23T23:56:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.162+0000 7efe7de00640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7efe5c06bbd0 0x7efe5c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.164+0000 7efe7de00640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7efe5c06bbd0 0x7efe5c06e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe70036000 tx=0x7efe7003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.166+0000 7efe76000640 1 -- 172.21.15.31:0/1862348814 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7efe68022030 con 0x7efe800b7fa0 2024-03-23T23:56:27.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.370+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efe800b9160 con 0x7efe800b7fa0 2024-03-23T23:56:27.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.370+0000 7efe76000640 1 -- 172.21.15.31:0/1862348814 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7efe801cdbc0 con 0x7efe800b7fa0 2024-03-23T23:56:27.370 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:27.371 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-03-23T23:56:27.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-03-23T23:56:27.371 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-03-23T23:56:27.371 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-03-23T23:56:27.371 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-03-23T23:56:27.371 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-03-23T23:56:27.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.373+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7efe5c06bbd0 msgr2=0x7efe5c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.373+0000 7efe7f200640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7efe5c06bbd0 0x7efe5c06e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe70036000 tx=0x7efe7003d040 comp rx=0 tx=0).stop 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.373+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe800b7fa0 msgr2=0x7efe801cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.373+0000 7efe7f200640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe800b7fa0 0x7efe801cafc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe6800d800 tx=0x7efe6800dcc0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 shutdown_connections 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7efe5c06bbd0 0x7efe5c06e090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe80144f20 0x7efe801ddab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe800b7fa0 0x7efe801cafc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 --2- 172.21.15.31:0/1862348814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe80072290 0x7efe801cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 >> 172.21.15.31:0/1862348814 conn(0x7efe8006cb70 msgr2=0x7efe800b9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 shutdown_connections 2024-03-23T23:56:27.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.374+0000 7efe7f200640 1 -- 172.21.15.31:0/1862348814 wait complete. 2024-03-23T23:56:27.391 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-23T23:56:27.391 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-23T23:56:27.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.610+0000 7fddc9600640 1 Processor -- start 2024-03-23T23:56:27.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.610+0000 7fddc9600640 1 -- start start 2024-03-23T23:56:27.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.611+0000 7fddc9600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fddc40b4f10 0x7fddc40b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.611+0000 7fddc9600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc4140bf0 0x7fddc4141040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.611+0000 7fddc9600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc40b52f0 con 0x7fddc414b430 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc9600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc40b6510 con 0x7fddc40b4f10 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc9600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc414a950 con 0x7fddc4140bf0 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fddc40b4f10 0x7fddc40b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc3400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fddc414b430 0x7fddc41471c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55968/0 (socket says 172.21.15.31:55968) 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fddc40b4f10 0x7fddc40b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44206/0 (socket says 172.21.15.31:44206) 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc3400640 1 -- 172.21.15.31:0/2788384982 learned_addr learned my addr 172.21.15.31:0/2788384982 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc8c00640 1 --2- 172.21.15.31:0/2788384982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc4140bf0 0x7fddc4141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc3e00640 1 -- 172.21.15.31:0/2788384982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc4140bf0 msgr2=0x7fddc4141040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc3e00640 1 --2- 172.21.15.31:0/2788384982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc4140bf0 0x7fddc4141040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc3e00640 1 -- 172.21.15.31:0/2788384982 >> v1:172.21.15.31:6789/0 conn(0x7fddc414b430 legacy=0x7fddc41471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.612+0000 7fddc2a00640 1 -- 172.21.15.31:0/2788384982 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007224326 0 0) 0x7fddc40b52f0 con 0x7fddc414b430 2024-03-23T23:56:27.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.613+0000 7fddc3e00640 1 -- 172.21.15.31:0/2788384982 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc414ac30 con 0x7fddc40b4f10 2024-03-23T23:56:27.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.614+0000 7fddc3e00640 1 --2- 172.21.15.31:0/2788384982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc40b4f10 0x7fddc40b69a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fddb40097a0 tx=0x7fddb402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90458f09cc4fd66c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.614+0000 7fddc2a00640 1 -- 172.21.15.31:0/2788384982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4035020 con 0x7fddc40b4f10 2024-03-23T23:56:27.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.614+0000 7fddc2a00640 1 -- 172.21.15.31:0/2788384982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4031830 con 0x7fddc40b4f10 2024-03-23T23:56:27.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.614+0000 7fddc2a00640 1 -- 172.21.15.31:0/2788384982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4031c00 con 0x7fddc40b4f10 2024-03-23T23:56:27.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 -- 172.21.15.31:0/2788384982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc40b4f10 msgr2=0x7fddc40b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 --2- 172.21.15.31:0/2788384982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc40b4f10 0x7fddc40b69a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fddb40097a0 tx=0x7fddb402b8d0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 -- 172.21.15.31:0/2788384982 shutdown_connections 2024-03-23T23:56:27.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 --2- 172.21.15.31:0/2788384982 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc4140bf0 0x7fddc4141040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 --2- 172.21.15.31:0/2788384982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc40b4f10 0x7fddc40b69a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 -- 172.21.15.31:0/2788384982 >> 172.21.15.31:0/2788384982 conn(0x7fddc4066dd0 msgr2=0x7fddc40671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:27.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 -- 172.21.15.31:0/2788384982 shutdown_connections 2024-03-23T23:56:27.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.615+0000 7fddc9600640 1 -- 172.21.15.31:0/2788384982 wait complete. 2024-03-23T23:56:27.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 Processor -- start 2024-03-23T23:56:27.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 -- start start 2024-03-23T23:56:27.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc40b4f10 0x7fddc4142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4140bf0 0x7fddc4143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc414b430 0x7fddc41dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4141580 con 0x7fddc414b430 2024-03-23T23:56:27.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40b6230 con 0x7fddc4140bf0 2024-03-23T23:56:27.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.617+0000 7fddc9600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc4141700 con 0x7fddc40b4f10 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc414b430 0x7fddc41dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc414b430 0x7fddc41dcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44216/0 (socket says 172.21.15.31:44216) 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 -- 172.21.15.31:0/3041359516 learned_addr learned my addr 172.21.15.31:0/3041359516 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc3e00640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc40b4f10 0x7fddc4142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc3400640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4140bf0 0x7fddc4143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 -- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc40b4f10 msgr2=0x7fddc4142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc40b4f10 0x7fddc4142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 -- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4140bf0 msgr2=0x7fddc4143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4140bf0 0x7fddc4143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.618+0000 7fddc8c00640 1 -- 172.21.15.31:0/3041359516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc4143eb0 con 0x7fddc414b430 2024-03-23T23:56:27.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.619+0000 7fddc8c00640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc414b430 0x7fddc41dcd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00d830 tx=0x7fddbc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.619+0000 7fddbbe00640 1 -- 172.21.15.31:0/3041359516 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00b6c0 con 0x7fddc414b430 2024-03-23T23:56:27.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.619+0000 7fddbbe00640 1 -- 172.21.15.31:0/3041359516 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc019070 con 0x7fddc414b430 2024-03-23T23:56:27.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.619+0000 7fddbbe00640 1 -- 172.21.15.31:0/3041359516 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00bac0 con 0x7fddc414b430 2024-03-23T23:56:27.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.619+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc413cbe0 con 0x7fddc414b430 2024-03-23T23:56:27.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.619+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc4144c10 con 0x7fddc414b430 2024-03-23T23:56:27.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.621+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc4144190 con 0x7fddc414b430 2024-03-23T23:56:27.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.622+0000 7fddbbe00640 1 -- 172.21.15.31:0/3041359516 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fddbc01e460 con 0x7fddc414b430 2024-03-23T23:56:27.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.622+0000 7fddbbe00640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdda006bbd0 0x7fdda006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:27.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.623+0000 7fddbbe00640 1 -- 172.21.15.31:0/3041359516 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fddbc08add0 con 0x7fddc414b430 2024-03-23T23:56:27.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.623+0000 7fddc3e00640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdda006bbd0 0x7fdda006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:27.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.624+0000 7fddc3e00640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdda006bbd0 0x7fdda006e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddb4036000 tx=0x7fddb4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:27.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.627+0000 7fddbbe00640 1 -- 172.21.15.31:0/3041359516 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fddc4144190 con 0x7fddc414b430 2024-03-23T23:56:27.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:27.829+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fddc40752c0 con 0x7fddc414b430 2024-03-23T23:56:28.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.832+0000 7fddbbe00640 1 -- 172.21.15.31:0/3041359516 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fddc4143eb0 con 0x7fddc414b430 2024-03-23T23:56:28.832 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-03-23T23:56:28.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdda006bbd0 msgr2=0x7fdda006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:28.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdda006bbd0 0x7fdda006e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddb4036000 tx=0x7fddb4008030 comp rx=0 tx=0).stop 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc414b430 msgr2=0x7fddc41dcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc414b430 0x7fddc41dcd50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00d830 tx=0x7fddbc00dcf0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 shutdown_connections 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdda006bbd0 0x7fdda006e090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddc4140bf0 0x7fddc4143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fddc414b430 0x7fddc41dcd50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 --2- 172.21.15.31:0/3041359516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddc40b4f10 0x7fddc4142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 >> 172.21.15.31:0/3041359516 conn(0x7fddc4066dd0 msgr2=0x7fddc414a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 shutdown_connections 2024-03-23T23:56:28.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:28.836+0000 7fddc9600640 1 -- 172.21.15.31:0/3041359516 wait complete. 2024-03-23T23:56:28.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-23T23:56:29.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.066+0000 7fcf79600640 1 Processor -- start 2024-03-23T23:56:29.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.066+0000 7fcf79600640 1 -- start start 2024-03-23T23:56:29.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.067+0000 7fcf79600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf7409bea0 0x7fcf741424d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.067+0000 7fcf79600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409da00 0x7fcf741451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.067+0000 7fcf79600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf74145710 0x7fcf741484d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.067+0000 7fcf79600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7409d570 con 0x7fcf7409bea0 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.067+0000 7fcf79600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf74145ba0 con 0x7fcf74145710 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.067+0000 7fcf79600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7409c280 con 0x7fcf7409da00 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.067+0000 7fcf73e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf7409bea0 0x7fcf741424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf73e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf7409bea0 0x7fcf741424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44230/0 (socket says 172.21.15.31:44230) 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf73e00640 1 -- 172.21.15.31:0/3333914603 learned_addr learned my addr 172.21.15.31:0/3333914603 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf78c00640 1 --2- 172.21.15.31:0/3333914603 >> v2:172.21.15.59:3300/0 conn(0x7fcf74145710 0x7fcf741484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf6be00640 1 --2- 172.21.15.31:0/3333914603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409da00 0x7fcf741451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf73e00640 1 -- 172.21.15.31:0/3333914603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409da00 msgr2=0x7fcf741451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:29.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf73e00640 1 --2- 172.21.15.31:0/3333914603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409da00 0x7fcf741451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf73e00640 1 -- 172.21.15.31:0/3333914603 >> v2:172.21.15.59:3300/0 conn(0x7fcf74145710 msgr2=0x7fcf741484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:29.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf73e00640 1 --2- 172.21.15.31:0/3333914603 >> v2:172.21.15.59:3300/0 conn(0x7fcf74145710 0x7fcf741484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf73e00640 1 -- 172.21.15.31:0/3333914603 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7406d500 con 0x7fcf7409bea0 2024-03-23T23:56:29.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.068+0000 7fcf78c00640 1 --2- 172.21.15.31:0/3333914603 >> v2:172.21.15.59:3300/0 conn(0x7fcf74145710 0x7fcf741484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:29.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.070+0000 7fcf73e00640 1 --2- 172.21.15.31:0/3333914603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7409bea0 0x7fcf741424d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf7409b490 tx=0x7fcf6402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de41bc11e24cd38 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.070+0000 7fcf73400640 1 -- 172.21.15.31:0/3333914603 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64035020 con 0x7fcf7409bea0 2024-03-23T23:56:29.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.070+0000 7fcf73400640 1 -- 172.21.15.31:0/3333914603 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf64031640 con 0x7fcf7409bea0 2024-03-23T23:56:29.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.070+0000 7fcf73400640 1 -- 172.21.15.31:0/3333914603 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6402d040 con 0x7fcf7409bea0 2024-03-23T23:56:29.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 -- 172.21.15.31:0/3333914603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7409bea0 msgr2=0x7fcf741424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 --2- 172.21.15.31:0/3333914603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7409bea0 0x7fcf741424d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcf7409b490 tx=0x7fcf6402b8f0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 -- 172.21.15.31:0/3333914603 shutdown_connections 2024-03-23T23:56:29.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 --2- 172.21.15.31:0/3333914603 >> v2:172.21.15.59:3300/0 conn(0x7fcf74145710 0x7fcf741484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 --2- 172.21.15.31:0/3333914603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409da00 0x7fcf741451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 --2- 172.21.15.31:0/3333914603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf7409bea0 0x7fcf741424d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 -- 172.21.15.31:0/3333914603 >> 172.21.15.31:0/3333914603 conn(0x7fcf7406ba20 msgr2=0x7fcf7406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:29.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 -- 172.21.15.31:0/3333914603 shutdown_connections 2024-03-23T23:56:29.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.071+0000 7fcf79600640 1 -- 172.21.15.31:0/3333914603 wait complete. 2024-03-23T23:56:29.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.073+0000 7fcf79600640 1 Processor -- start 2024-03-23T23:56:29.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.073+0000 7fcf79600640 1 -- start start 2024-03-23T23:56:29.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf79600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7409bea0 0x7fcf740b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf79600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74145710 0x7fcf740b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf79600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409a630 0x7fcf7409aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf79600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740b5680 con 0x7fcf74145710 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf79600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740b53a0 con 0x7fcf7409bea0 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf79600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7409b6f0 con 0x7fcf7409a630 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74145710 0x7fcf740b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74145710 0x7fcf740b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44234/0 (socket says 172.21.15.31:44234) 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.074+0000 7fcf6be00640 1 -- 172.21.15.31:0/1081741900 learned_addr learned my addr 172.21.15.31:0/1081741900 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf73e00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7409bea0 0x7fcf740b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf78c00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409a630 0x7fcf7409aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf6be00640 1 -- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409a630 msgr2=0x7fcf7409aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf6be00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409a630 0x7fcf7409aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf6be00640 1 -- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7409bea0 msgr2=0x7fcf740b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf6be00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7409bea0 0x7fcf740b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf6be00640 1 -- 172.21.15.31:0/1081741900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74137900 con 0x7fcf74145710 2024-03-23T23:56:29.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf6be00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74145710 0x7fcf740b7700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00e890 tx=0x7fcf5c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf70c00640 1 -- 172.21.15.31:0/1081741900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c017070 con 0x7fcf74145710 2024-03-23T23:56:29.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf70c00640 1 -- 172.21.15.31:0/1081741900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00c940 con 0x7fcf74145710 2024-03-23T23:56:29.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf70c00640 1 -- 172.21.15.31:0/1081741900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00cd10 con 0x7fcf74145710 2024-03-23T23:56:29.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.075+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7413a1d0 con 0x7fcf74145710 2024-03-23T23:56:29.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.076+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74137b70 con 0x7fcf74145710 2024-03-23T23:56:29.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.077+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74073330 con 0x7fcf74145710 2024-03-23T23:56:29.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.078+0000 7fcf70c00640 1 -- 172.21.15.31:0/1081741900 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcf5c01a070 con 0x7fcf74145710 2024-03-23T23:56:29.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.079+0000 7fcf70c00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5006bbd0 0x7fcf5006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:29.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.079+0000 7fcf70c00640 1 -- 172.21.15.31:0/1081741900 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fcf5c08abf0 con 0x7fcf74145710 2024-03-23T23:56:29.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.079+0000 7fcf73e00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5006bbd0 0x7fcf5006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:29.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.080+0000 7fcf73e00640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5006bbd0 0x7fcf5006e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf64036000 tx=0x7fcf6403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:29.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.084+0000 7fcf70c00640 1 -- 172.21.15.31:0/1081741900 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fcf74073330 con 0x7fcf74145710 2024-03-23T23:56:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.284+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcf740752c0 con 0x7fcf74145710 2024-03-23T23:56:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.850+0000 7fcf70c00640 1 -- 172.21.15.31:0/1081741900 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcf5c0598b0 con 0x7fcf74145710 2024-03-23T23:56:29.850 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5006bbd0 msgr2=0x7fcf5006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5006bbd0 0x7fcf5006e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf64036000 tx=0x7fcf6403c040 comp rx=0 tx=0).stop 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74145710 msgr2=0x7fcf740b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74145710 0x7fcf740b7700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00e890 tx=0x7fcf5c00ed50 comp rx=0 tx=0).stop 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 shutdown_connections 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcf5006bbd0 0x7fcf5006e090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf7409a630 0x7fcf7409aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74145710 0x7fcf740b7700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 --2- 172.21.15.31:0/1081741900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7409bea0 0x7fcf740b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:29.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 >> 172.21.15.31:0/1081741900 conn(0x7fcf7406ba20 msgr2=0x7fcf7413ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:29.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 shutdown_connections 2024-03-23T23:56:29.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:29.854+0000 7fcf79600640 1 -- 172.21.15.31:0/1081741900 wait complete. 2024-03-23T23:56:29.889 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-23T23:56:30.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.076+0000 7fe1f5000640 1 Processor -- start 2024-03-23T23:56:30.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.076+0000 7fe1f5000640 1 -- start start 2024-03-23T23:56:30.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.077+0000 7fe1f5000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe1f00b50a0 0x7fe1f0147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.077+0000 7fe1f5000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f00b9330 con 0x7fe1f00b6b50 2024-03-23T23:56:30.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.077+0000 7fe1f5000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f00b5480 con 0x7fe1f00b9810 2024-03-23T23:56:30.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.077+0000 7fe1f5000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f0147660 con 0x7fe1f00b50a0 2024-03-23T23:56:30.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.078+0000 7fe1ef400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe1f00b50a0 0x7fe1f0147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.078+0000 7fe1eea00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe1f00b6b50 0x7fe1f0140c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55984/0 (socket says 172.21.15.31:55984) 2024-03-23T23:56:30.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.078+0000 7fe1eea00640 1 -- 172.21.15.31:0/2370407096 learned_addr learned my addr 172.21.15.31:0/2370407096 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:30.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.078+0000 7fe1ef400640 1 -- 172.21.15.31:0/2370407096 >> v1:172.21.15.59:6789/0 conn(0x7fe1f00b9810 legacy=0x7fe1f0151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:30.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.078+0000 7fe1ef400640 1 -- 172.21.15.31:0/2370407096 >> v1:172.21.15.31:6789/0 conn(0x7fe1f00b6b50 legacy=0x7fe1f0140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.078+0000 7fe1ef400640 1 -- 172.21.15.31:0/2370407096 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00b66c0 con 0x7fe1f00b50a0 2024-03-23T23:56:30.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.078+0000 7fe1ee000640 1 -- 172.21.15.31:0/2370407096 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333958215 0 0) 0x7fe1f00b9330 con 0x7fe1f00b6b50 2024-03-23T23:56:30.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.080+0000 7fe1ef400640 1 --2- 172.21.15.31:0/2370407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0147120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835b764bc5fb269b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.080+0000 7fe1ee000640 1 -- 172.21.15.31:0/2370407096 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00315a0 con 0x7fe1f00b50a0 2024-03-23T23:56:30.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.080+0000 7fe1ee000640 1 -- 172.21.15.31:0/2370407096 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0037070 con 0x7fe1f00b50a0 2024-03-23T23:56:30.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.080+0000 7fe1ee000640 1 -- 172.21.15.31:0/2370407096 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0031960 con 0x7fe1f00b50a0 2024-03-23T23:56:30.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.080+0000 7fe1f5000640 1 -- 172.21.15.31:0/2370407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 msgr2=0x7fe1f0147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.080+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2370407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0147120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e002b840 comp rx=0 tx=0).stop 2024-03-23T23:56:30.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.081+0000 7fe1f5000640 1 -- 172.21.15.31:0/2370407096 shutdown_connections 2024-03-23T23:56:30.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.081+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2370407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0147120 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.081+0000 7fe1f5000640 1 -- 172.21.15.31:0/2370407096 >> 172.21.15.31:0/2370407096 conn(0x7fe1f0066dd0 msgr2=0x7fe1f00671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:30.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.081+0000 7fe1f5000640 1 -- 172.21.15.31:0/2370407096 shutdown_connections 2024-03-23T23:56:30.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.081+0000 7fe1f5000640 1 -- 172.21.15.31:0/2370407096 wait complete. 2024-03-23T23:56:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.082+0000 7fe1f5000640 1 Processor -- start 2024-03-23T23:56:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.082+0000 7fe1f5000640 1 -- start start 2024-03-23T23:56:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1f5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1f5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f00b6b50 0x7fe1f01374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1f5000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1f00b9810 0x7fe1f01dc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1f5000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b42e0 con 0x7fe1f00b50a0 2024-03-23T23:56:30.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1f5000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b63e0 con 0x7fe1f00b6b50 2024-03-23T23:56:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1f5000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0141340 con 0x7fe1f00b9810 2024-03-23T23:56:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1ef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1ef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44252/0 (socket says 172.21.15.31:44252) 2024-03-23T23:56:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.083+0000 7fe1ef400640 1 -- 172.21.15.31:0/2167509674 learned_addr learned my addr 172.21.15.31:0/2167509674 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1eea00640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f00b6b50 0x7fe1f01374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1efe00640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1f00b9810 0x7fe1f01dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1ef400640 1 -- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1f00b9810 msgr2=0x7fe1f01dc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1ef400640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1f00b9810 0x7fe1f01dc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1ef400640 1 -- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f00b6b50 msgr2=0x7fe1f01374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1ef400640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f00b6b50 0x7fe1f01374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1ef400640 1 -- 172.21.15.31:0/2167509674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f014b400 con 0x7fe1f00b50a0 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1eea00640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f00b6b50 0x7fe1f01374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1efe00640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1f00b9810 0x7fe1f01dc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.084+0000 7fe1ef400640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0143e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.085+0000 7fe1e7400640 1 -- 172.21.15.31:0/2167509674 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0004030 con 0x7fe1f00b50a0 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.085+0000 7fe1e7400640 1 -- 172.21.15.31:0/2167509674 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00041f0 con 0x7fe1f00b50a0 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.085+0000 7fe1e7400640 1 -- 172.21.15.31:0/2167509674 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0032640 con 0x7fe1f00b50a0 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.085+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f0137a20 con 0x7fe1f00b50a0 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.085+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f014b120 con 0x7fe1f00b50a0 2024-03-23T23:56:30.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.086+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f00752c0 con 0x7fe1f00b50a0 2024-03-23T23:56:30.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.087+0000 7fe1e7400640 1 -- 172.21.15.31:0/2167509674 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe1e00327e0 con 0x7fe1f00b50a0 2024-03-23T23:56:30.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.088+0000 7fe1e7400640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe1d006bbd0 0x7fe1d006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:30.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.088+0000 7fe1e7400640 1 -- 172.21.15.31:0/2167509674 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe1e002f030 con 0x7fe1f00b50a0 2024-03-23T23:56:30.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.089+0000 7fe1eea00640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe1d006bbd0 0x7fe1d006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:30.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.090+0000 7fe1eea00640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe1d006bbd0 0x7fe1d006e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007fd0 tx=0x7fe1dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:30.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.093+0000 7fe1e7400640 1 -- 172.21.15.31:0/2167509674 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe1e0041070 con 0x7fe1f00b50a0 2024-03-23T23:56:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.335+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe1f0142690 con 0x7fe1f00b50a0 2024-03-23T23:56:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.865+0000 7fe1e7400640 1 -- 172.21.15.31:0/2167509674 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe1e007b650 con 0x7fe1f00b50a0 2024-03-23T23:56:30.867 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2024-03-23T23:56:30.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe1d006bbd0 msgr2=0x7fe1d006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe1d006bbd0 0x7fe1d006e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007fd0 tx=0x7fe1dc009040 comp rx=0 tx=0).stop 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 msgr2=0x7fe1f0143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0143e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e00046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 shutdown_connections 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe1d006bbd0 0x7fe1d006e090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f00b6b50 0x7fe1f01374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1f00b9810 0x7fe1f01dc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 --2- 172.21.15.31:0/2167509674 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1f00b50a0 0x7fe1f0143e70 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e00046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 >> 172.21.15.31:0/2167509674 conn(0x7fe1f0066dd0 msgr2=0x7fe1f013f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:30.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.875+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 shutdown_connections 2024-03-23T23:56:30.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:30.877+0000 7fe1f5000640 1 -- 172.21.15.31:0/2167509674 wait complete. 2024-03-23T23:56:30.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:31.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.091+0000 7ff661800640 1 Processor -- start 2024-03-23T23:56:31.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.091+0000 7ff661800640 1 -- start start 2024-03-23T23:56:31.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.093+0000 7ff661800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b7cc0 0x7ff65c06cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.093+0000 7ff661800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c06c360 con 0x7ff65c14b020 2024-03-23T23:56:31.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.093+0000 7ff661800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65c0b80a0 con 0x7ff65c0b71d0 2024-03-23T23:56:31.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.093+0000 7ff661800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c06d400 con 0x7ff65c0b7cc0 2024-03-23T23:56:31.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.093+0000 7ff65b400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff65c14b020 0x7ff65c141020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55990/0 (socket says 172.21.15.31:55990) 2024-03-23T23:56:31.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.093+0000 7ff65b400640 1 -- 172.21.15.31:0/4270293933 learned_addr learned my addr 172.21.15.31:0/4270293933 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:31.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.093+0000 7ff65aa00640 1 --2- 172.21.15.31:0/4270293933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b7cc0 0x7ff65c06cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.094+0000 7ff65a000640 1 -- 172.21.15.31:0/4270293933 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156352794 0 0) 0x7ff65c06c360 con 0x7ff65c14b020 2024-03-23T23:56:31.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.094+0000 7ff65a000640 1 -- 172.21.15.31:0/4270293933 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff640003520 con 0x7ff65c14b020 2024-03-23T23:56:31.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.094+0000 7ff65aa00640 1 -- 172.21.15.31:0/4270293933 >> v1:172.21.15.59:6789/0 conn(0x7ff65c0b71d0 legacy=0x7ff65c14a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.094+0000 7ff65a000640 1 -- 172.21.15.31:0/4270293933 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 257958838 0 0) 0x7ff640003520 con 0x7ff65c14b020 2024-03-23T23:56:31.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.094+0000 7ff65aa00640 1 -- 172.21.15.31:0/4270293933 >> v1:172.21.15.31:6789/0 conn(0x7ff65c14b020 legacy=0x7ff65c141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.094+0000 7ff65aa00640 1 -- 172.21.15.31:0/4270293933 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c06d6e0 con 0x7ff65c0b7cc0 2024-03-23T23:56:31.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.095+0000 7ff65aa00640 1 --2- 172.21.15.31:0/4270293933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b7cc0 0x7ff65c06cad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009dc0 tx=0x7ff64c02bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5a1025644c06c89 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:31.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.096+0000 7ff65a000640 1 -- 172.21.15.31:0/4270293933 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c039070 con 0x7ff65c0b7cc0 2024-03-23T23:56:31.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.096+0000 7ff65a000640 1 -- 172.21.15.31:0/4270293933 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c02c910 con 0x7ff65c0b7cc0 2024-03-23T23:56:31.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.096+0000 7ff65a000640 1 -- 172.21.15.31:0/4270293933 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654001670 con 0x7ff65c0b7cc0 2024-03-23T23:56:31.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.096+0000 7ff661800640 1 -- 172.21.15.31:0/4270293933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b7cc0 msgr2=0x7ff65c06cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.096+0000 7ff661800640 1 --2- 172.21.15.31:0/4270293933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b7cc0 0x7ff65c06cad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009dc0 tx=0x7ff64c02bde0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.097+0000 7ff661800640 1 -- 172.21.15.31:0/4270293933 shutdown_connections 2024-03-23T23:56:31.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.097+0000 7ff661800640 1 --2- 172.21.15.31:0/4270293933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b7cc0 0x7ff65c06cad0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.097+0000 7ff661800640 1 -- 172.21.15.31:0/4270293933 >> 172.21.15.31:0/4270293933 conn(0x7ff65c0671c0 msgr2=0x7ff65c0675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:31.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.097+0000 7ff661800640 1 -- 172.21.15.31:0/4270293933 shutdown_connections 2024-03-23T23:56:31.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.097+0000 7ff661800640 1 -- 172.21.15.31:0/4270293933 wait complete. 2024-03-23T23:56:31.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.098+0000 7ff661800640 1 Processor -- start 2024-03-23T23:56:31.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.098+0000 7ff661800640 1 -- start start 2024-03-23T23:56:31.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff661800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b71d0 0x7ff65c144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff661800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff65c0b7cc0 0x7ff65c1e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff661800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65c14b020 0x7ff65c1dd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff661800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c141b00 con 0x7ff65c14b020 2024-03-23T23:56:31.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff661800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c141980 con 0x7ff65c0b7cc0 2024-03-23T23:56:31.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff661800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c152c50 con 0x7ff65c0b71d0 2024-03-23T23:56:31.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff65b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65c14b020 0x7ff65c1dd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff65b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65c14b020 0x7ff65c1dd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44258/0 (socket says 172.21.15.31:44258) 2024-03-23T23:56:31.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.099+0000 7ff65b400640 1 -- 172.21.15.31:0/1814934352 learned_addr learned my addr 172.21.15.31:0/1814934352 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:31.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65aa00640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b71d0 0x7ff65c144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff652000640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff65c0b7cc0 0x7ff65c1e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65b400640 1 -- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b71d0 msgr2=0x7ff65c144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65b400640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b71d0 0x7ff65c144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65b400640 1 -- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff65c0b7cc0 msgr2=0x7ff65c1e0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65b400640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff65c0b7cc0 0x7ff65c1e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65b400640 1 -- 172.21.15.31:0/1814934352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c1484c0 con 0x7ff65c14b020 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65aa00640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b71d0 0x7ff65c144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff65b400640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65c14b020 0x7ff65c1dd360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6540011e0 tx=0x7ff65400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff653400640 1 -- 172.21.15.31:0/1814934352 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654005ce0 con 0x7ff65c14b020 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff653400640 1 -- 172.21.15.31:0/1814934352 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654007070 con 0x7ff65c14b020 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.100+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c0b4020 con 0x7ff65c14b020 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.101+0000 7ff653400640 1 -- 172.21.15.31:0/1814934352 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654007460 con 0x7ff65c14b020 2024-03-23T23:56:31.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.101+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c143120 con 0x7ff65c14b020 2024-03-23T23:56:31.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.102+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c04f400 con 0x7ff65c14b020 2024-03-23T23:56:31.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.103+0000 7ff653400640 1 -- 172.21.15.31:0/1814934352 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff654007600 con 0x7ff65c14b020 2024-03-23T23:56:31.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.104+0000 7ff653400640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff63806bbd0 0x7ff63806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.105+0000 7ff653400640 1 -- 172.21.15.31:0/1814934352 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff65408a6c0 con 0x7ff65c14b020 2024-03-23T23:56:31.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.105+0000 7ff65aa00640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff63806bbd0 0x7ff63806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.106+0000 7ff65aa00640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff63806bbd0 0x7ff63806e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff64c036000 tx=0x7ff64c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:31.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.109+0000 7ff653400640 1 -- 172.21.15.31:0/1814934352 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff654059240 con 0x7ff65c14b020 2024-03-23T23:56:31.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.311+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff65c144150 con 0x7ff65c14b020 2024-03-23T23:56:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.314+0000 7ff653400640 1 -- 172.21.15.31:0/1814934352 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16546 (secure 0 0 0) 0x7ff654058b40 con 0x7ff65c14b020 2024-03-23T23:56:31.314 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:31.314 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:30.337104+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.316+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff63806bbd0 msgr2=0x7ff63806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.316+0000 7ff661800640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff63806bbd0 0x7ff63806e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff64c036000 tx=0x7ff64c030000 comp rx=0 tx=0).stop 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.316+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65c14b020 msgr2=0x7ff65c1dd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.316+0000 7ff661800640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65c14b020 0x7ff65c1dd360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6540011e0 tx=0x7ff65400c9b0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 shutdown_connections 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff63806bbd0 0x7ff63806e090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff65c0b7cc0 0x7ff65c1e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff65c14b020 0x7ff65c1dd360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 --2- 172.21.15.31:0/1814934352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff65c0b71d0 0x7ff65c144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 >> 172.21.15.31:0/1814934352 conn(0x7ff65c0671c0 msgr2=0x7ff65c0ba8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:31.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 shutdown_connections 2024-03-23T23:56:31.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.317+0000 7ff661800640 1 -- 172.21.15.31:0/1814934352 wait complete. 2024-03-23T23:56:31.337 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:31.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.559+0000 7f387e000640 1 Processor -- start 2024-03-23T23:56:31.559 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.559+0000 7f387e000640 1 -- start start 2024-03-23T23:56:31.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.560+0000 7f387e000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38780b6a30 0x7f38780b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.560+0000 7f387e000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f3878144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.560+0000 7f387e000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f38780b79b0 0x7f3878144850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.560+0000 7f387e000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780b3480 con 0x7f38780b6a30 2024-03-23T23:56:31.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.560+0000 7f387e000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38780b36d0 con 0x7f38780b79b0 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.560+0000 7f387e000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38780b6e10 con 0x7f38780b7530 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38780b6a30 0x7f38780b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38780b6a30 0x7f38780b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44272/0 (socket says 172.21.15.31:44272) 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 -- 172.21.15.31:0/2873366196 learned_addr learned my addr 172.21.15.31:0/2873366196 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387d600640 1 --2- 172.21.15.31:0/2873366196 >> v2:172.21.15.59:3300/0 conn(0x7f38780b79b0 0x7f3878144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f386fe00640 1 --2- 172.21.15.31:0/2873366196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f3878144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 -- 172.21.15.31:0/2873366196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 msgr2=0x7f3878144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 --2- 172.21.15.31:0/2873366196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f3878144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 -- 172.21.15.31:0/2873366196 >> v2:172.21.15.59:3300/0 conn(0x7f38780b79b0 msgr2=0x7f3878144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 --2- 172.21.15.31:0/2873366196 >> v2:172.21.15.59:3300/0 conn(0x7f38780b79b0 0x7f3878144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.561+0000 7f387cc00640 1 -- 172.21.15.31:0/2873366196 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38780b3d20 con 0x7f38780b6a30 2024-03-23T23:56:31.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.563+0000 7f387cc00640 1 --2- 172.21.15.31:0/2873366196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f38780b8640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f387806eaf0 tx=0x7f386802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04ba9cc8dc672d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:31.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.563+0000 7f3877e00640 1 -- 172.21.15.31:0/2873366196 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868035020 con 0x7f38780b6a30 2024-03-23T23:56:31.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.563+0000 7f3877e00640 1 -- 172.21.15.31:0/2873366196 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868031870 con 0x7f38780b6a30 2024-03-23T23:56:31.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.563+0000 7f3877e00640 1 -- 172.21.15.31:0/2873366196 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868031c40 con 0x7f38780b6a30 2024-03-23T23:56:31.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 -- 172.21.15.31:0/2873366196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 msgr2=0x7f38780b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 --2- 172.21.15.31:0/2873366196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f38780b8640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f387806eaf0 tx=0x7f386802b910 comp rx=0 tx=0).stop 2024-03-23T23:56:31.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 -- 172.21.15.31:0/2873366196 shutdown_connections 2024-03-23T23:56:31.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 --2- 172.21.15.31:0/2873366196 >> v2:172.21.15.59:3300/0 conn(0x7f38780b79b0 0x7f3878144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 --2- 172.21.15.31:0/2873366196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f3878144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 --2- 172.21.15.31:0/2873366196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f38780b8640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 -- 172.21.15.31:0/2873366196 >> 172.21.15.31:0/2873366196 conn(0x7f387806cf40 msgr2=0x7f387806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 -- 172.21.15.31:0/2873366196 shutdown_connections 2024-03-23T23:56:31.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.564+0000 7f387e000640 1 -- 172.21.15.31:0/2873366196 wait complete. 2024-03-23T23:56:31.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.565+0000 7f387e000640 1 Processor -- start 2024-03-23T23:56:31.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.566+0000 7f387e000640 1 -- start start 2024-03-23T23:56:31.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.566+0000 7f387e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f387813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.566+0000 7f387e000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f387814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38780b79b0 0x7f38781e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387e000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780b8b80 con 0x7f38780b6a30 2024-03-23T23:56:31.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38780b42e0 con 0x7f38780b79b0 2024-03-23T23:56:31.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387e000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38781d1480 con 0x7f38780b7530 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f387813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f387813ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44280/0 (socket says 172.21.15.31:44280) 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 -- 172.21.15.31:0/98958258 learned_addr learned my addr 172.21.15.31:0/98958258 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387d600640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38780b79b0 0x7f38781e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f386fe00640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f387814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 -- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 msgr2=0x7f387814a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f387814a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 -- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38780b79b0 msgr2=0x7f38781e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38780b79b0 0x7f38781e0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387cc00640 1 -- 172.21.15.31:0/98958258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38781d0960 con 0x7f38780b6a30 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.567+0000 7f387d600640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38780b79b0 0x7f38781e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.568+0000 7f387cc00640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f387813ee00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3868000c00 tx=0x7f38680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:31.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.568+0000 7f3875600640 1 -- 172.21.15.31:0/98958258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386803ad60 con 0x7f38780b6a30 2024-03-23T23:56:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.568+0000 7f3875600640 1 -- 172.21.15.31:0/98958258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38680443f0 con 0x7f38780b6a30 2024-03-23T23:56:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.568+0000 7f3875600640 1 -- 172.21.15.31:0/98958258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680447e0 con 0x7f38780b6a30 2024-03-23T23:56:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.568+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38781d0680 con 0x7f38780b6a30 2024-03-23T23:56:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.568+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38781d16d0 con 0x7f38780b6a30 2024-03-23T23:56:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.570+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38780752c0 con 0x7f38780b6a30 2024-03-23T23:56:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.570+0000 7f3875600640 1 -- 172.21.15.31:0/98958258 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3868038020 con 0x7f38780b6a30 2024-03-23T23:56:31.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.571+0000 7f3875600640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f385406bbd0 0x7f385406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:31.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.571+0000 7f3875600640 1 -- 172.21.15.31:0/98958258 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38680acbb0 con 0x7f38780b6a30 2024-03-23T23:56:31.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.572+0000 7f386fe00640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f385406bbd0 0x7f385406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:31.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.573+0000 7f386fe00640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f385406bbd0 0x7f385406e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f387814b1f0 tx=0x7f3860008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:31.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.576+0000 7f3875600640 1 -- 172.21.15.31:0/98958258 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f386803f070 con 0x7f38780b6a30 2024-03-23T23:56:31.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.779+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38780b2b00 con 0x7f38780b6a30 2024-03-23T23:56:31.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.782+0000 7f3875600640 1 -- 172.21.15.31:0/98958258 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16546 (secure 0 0 0) 0x7f386807b730 con 0x7f38780b6a30 2024-03-23T23:56:31.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:31.782 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:30.337104+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.784+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f385406bbd0 msgr2=0x7f385406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.784+0000 7f387e000640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f385406bbd0 0x7f385406e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f387814b1f0 tx=0x7f3860008040 comp rx=0 tx=0).stop 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.784+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 msgr2=0x7f387813ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.784+0000 7f387e000640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f387813ee00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3868000c00 tx=0x7f38680046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 shutdown_connections 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f385406bbd0 0x7f385406e090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38780b79b0 0x7f38781e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38780b7530 0x7f387814a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 --2- 172.21.15.31:0/98958258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38780b6a30 0x7f387813ee00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 >> 172.21.15.31:0/98958258 conn(0x7f387806cf40 msgr2=0x7f38781407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 shutdown_connections 2024-03-23T23:56:31.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:31.785+0000 7f387e000640 1 -- 172.21.15.31:0/98958258 wait complete. 2024-03-23T23:56:31.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-23T23:56:32.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.030+0000 7f23b0e00640 1 Processor -- start 2024-03-23T23:56:32.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.030+0000 7f23b0e00640 1 -- start start 2024-03-23T23:56:32.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.031+0000 7f23b0e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23ac141560 0x7f23ac152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:32.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.031+0000 7f23b0e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0b8d70 con 0x7f23ac0b51b0 2024-03-23T23:56:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.031+0000 7f23b0e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0b9b00 con 0x7f23ac0b6b30 2024-03-23T23:56:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.031+0000 7f23b0e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0b8fe0 con 0x7f23ac141560 2024-03-23T23:56:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.032+0000 7f23abe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23ac141560 0x7f23ac152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.032+0000 7f23abe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23ac141560 0x7f23ac152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44296/0 (socket says 172.21.15.31:44296) 2024-03-23T23:56:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.032+0000 7f23abe00640 1 -- 172.21.15.31:0/2908133714 learned_addr learned my addr 172.21.15.31:0/2908133714 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:32.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.032+0000 7f23abe00640 1 -- 172.21.15.31:0/2908133714 >> v1:172.21.15.59:6789/0 conn(0x7f23ac0b6b30 legacy=0x7f23ac140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:32.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.032+0000 7f23abe00640 1 -- 172.21.15.31:0/2908133714 >> v1:172.21.15.31:6789/0 conn(0x7f23ac0b51b0 legacy=0x7f23ac14a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:32.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.032+0000 7f23abe00640 1 -- 172.21.15.31:0/2908133714 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0b9fe0 con 0x7f23ac141560 2024-03-23T23:56:32.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.033+0000 7f23abe00640 1 --2- 172.21.15.31:0/2908133714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac141560 0x7f23ac152be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e50 tx=0x7f23a402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a0c2b7261e4fd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:32.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23aaa00640 1 -- 172.21.15.31:0/2908133714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a402cb10 con 0x7f23ac141560 2024-03-23T23:56:32.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23aaa00640 1 -- 172.21.15.31:0/2908133714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a402ccb0 con 0x7f23ac141560 2024-03-23T23:56:32.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23aaa00640 1 -- 172.21.15.31:0/2908133714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a402ce60 con 0x7f23ac141560 2024-03-23T23:56:32.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23b0e00640 1 -- 172.21.15.31:0/2908133714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac141560 msgr2=0x7f23ac152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:32.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23b0e00640 1 --2- 172.21.15.31:0/2908133714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac141560 0x7f23ac152be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e50 tx=0x7f23a402bf70 comp rx=0 tx=0).stop 2024-03-23T23:56:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23b0e00640 1 -- 172.21.15.31:0/2908133714 shutdown_connections 2024-03-23T23:56:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23b0e00640 1 --2- 172.21.15.31:0/2908133714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac141560 0x7f23ac152be0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23b0e00640 1 -- 172.21.15.31:0/2908133714 >> 172.21.15.31:0/2908133714 conn(0x7f23ac0671f0 msgr2=0x7f23ac067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.034+0000 7f23b0e00640 1 -- 172.21.15.31:0/2908133714 shutdown_connections 2024-03-23T23:56:32.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.035+0000 7f23b0e00640 1 -- 172.21.15.31:0/2908133714 wait complete. 2024-03-23T23:56:32.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.036+0000 7f23b0e00640 1 Processor -- start 2024-03-23T23:56:32.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.036+0000 7f23b0e00640 1 -- start start 2024-03-23T23:56:32.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.037+0000 7f23b0e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0b51b0 0x7f23ac13b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:32.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.037+0000 7f23b0e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac0b6b30 0x7f23ac1e0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:32.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.037+0000 7f23b0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac141560 0x7f23ac135c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.037+0000 7f23b0e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b5590 con 0x7f23ac0b6b30 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.037+0000 7f23b0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac14af50 con 0x7f23ac141560 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.037+0000 7f23b0e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b3dd0 con 0x7f23ac0b51b0 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.037+0000 7f23a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac0b6b30 0x7f23ac1e0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23abe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac141560 0x7f23ac135c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac0b6b30 0x7f23ac1e0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44312/0 (socket says 172.21.15.31:44312) 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 -- 172.21.15.31:0/3621500634 learned_addr learned my addr 172.21.15.31:0/3621500634 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:32.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23ab400640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0b51b0 0x7f23ac13b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 -- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0b51b0 msgr2=0x7f23ac13b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0b51b0 0x7f23ac13b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 -- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac141560 msgr2=0x7f23ac135c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:32.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac141560 0x7f23ac135c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 -- 172.21.15.31:0/3621500634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac1e07a0 con 0x7f23ac0b6b30 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.038+0000 7f23a3e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac0b6b30 0x7f23ac1e0260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f239400c400 tx=0x7f239400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.039+0000 7f23a3400640 1 -- 172.21.15.31:0/3621500634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940052d0 con 0x7f23ac0b6b30 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.039+0000 7f23a3400640 1 -- 172.21.15.31:0/3621500634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394005490 con 0x7f23ac0b6b30 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.039+0000 7f23a3400640 1 -- 172.21.15.31:0/3621500634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394007260 con 0x7f23ac0b6b30 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.039+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0bc270 con 0x7f23ac0b6b30 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.039+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0bd670 con 0x7f23ac0b6b30 2024-03-23T23:56:32.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.040+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0752c0 con 0x7f23ac0b6b30 2024-03-23T23:56:32.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.041+0000 7f23a3400640 1 -- 172.21.15.31:0/3621500634 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2394007400 con 0x7f23ac0b6b30 2024-03-23T23:56:32.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.042+0000 7f23a3400640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f238806bbd0 0x7f238806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:32.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.042+0000 7f23a3400640 1 -- 172.21.15.31:0/3621500634 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2394089f40 con 0x7f23ac0b6b30 2024-03-23T23:56:32.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.043+0000 7f23ab400640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f238806bbd0 0x7f238806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:32.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.043+0000 7f23ab400640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f238806bbd0 0x7f238806e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f239c000f60 tx=0x7f239c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:32.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.047+0000 7f23a3400640 1 -- 172.21.15.31:0/3621500634 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f23940583d0 con 0x7f23ac0b6b30 2024-03-23T23:56:32.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.293+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f23ac144c70 con 0x7f23ac0b6b30 2024-03-23T23:56:32.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.875+0000 7f23a3400640 1 -- 172.21.15.31:0/3621500634 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f239405c470 con 0x7f23ac0b6b30 2024-03-23T23:56:32.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f238806bbd0 msgr2=0x7f238806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f238806bbd0 0x7f238806e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f239c000f60 tx=0x7f239c009040 comp rx=0 tx=0).stop 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac0b6b30 msgr2=0x7f23ac1e0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac0b6b30 0x7f23ac1e0260 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f239400c400 tx=0x7f239400c8c0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 shutdown_connections 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f238806bbd0 0x7f238806e090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac141560 0x7f23ac135c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23ac0b6b30 0x7f23ac1e0260 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 --2- 172.21.15.31:0/3621500634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0b51b0 0x7f23ac13b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.879+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 >> 172.21.15.31:0/3621500634 conn(0x7f23ac0671f0 msgr2=0x7f23ac1468a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.880+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 shutdown_connections 2024-03-23T23:56:32.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:32.880+0000 7f23b0e00640 1 -- 172.21.15.31:0/3621500634 wait complete. 2024-03-23T23:56:32.901 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-23T23:56:32.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-23T23:56:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.122+0000 7fd73de00640 1 Processor -- start 2024-03-23T23:56:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.122+0000 7fd73de00640 1 -- start start 2024-03-23T23:56:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.123+0000 7fd73de00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380732e0 0x7fd7380ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.123+0000 7fd73de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd73814a6d0 0x7fd7380b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.124+0000 7fd73de00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7380736c0 con 0x7fd7380b4800 2024-03-23T23:56:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.124+0000 7fd73de00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380b5570 con 0x7fd73814a6d0 2024-03-23T23:56:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.124+0000 7fd73de00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380af800 con 0x7fd7380732e0 2024-03-23T23:56:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.124+0000 7fd737e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd73814a6d0 0x7fd7380b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.124+0000 7fd737e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd73814a6d0 0x7fd7380b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:43104/0 (socket says 172.21.15.31:43104) 2024-03-23T23:56:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.124+0000 7fd73ca00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380732e0 0x7fd7380ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.124+0000 7fd737e00640 1 -- 172.21.15.31:0/2480831551 learned_addr learned my addr 172.21.15.31:0/2480831551 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.125+0000 7fd737e00640 1 -- 172.21.15.31:0/2480831551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380732e0 msgr2=0x7fd7380ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:33.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.125+0000 7fd737e00640 1 --2- 172.21.15.31:0/2480831551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380732e0 0x7fd7380ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.125+0000 7fd737e00640 1 -- 172.21.15.31:0/2480831551 >> v1:172.21.15.59:6789/0 conn(0x7fd7380b4800 legacy=0x7fd738140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:33.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.125+0000 7fd737e00640 1 -- 172.21.15.31:0/2480831551 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b5f40 con 0x7fd73814a6d0 2024-03-23T23:56:33.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.126+0000 7fd737e00640 1 --2- 172.21.15.31:0/2480831551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73814a6d0 0x7fd7380b5a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd728009870 tx=0x7fd72802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d60cf1b37f702470 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:33.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.127+0000 7fd737400640 1 -- 172.21.15.31:0/2480831551 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7280317c0 con 0x7fd73814a6d0 2024-03-23T23:56:33.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.127+0000 7fd737400640 1 -- 172.21.15.31:0/2480831551 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd728037070 con 0x7fd73814a6d0 2024-03-23T23:56:33.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.127+0000 7fd737400640 1 -- 172.21.15.31:0/2480831551 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd728031b80 con 0x7fd73814a6d0 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 -- 172.21.15.31:0/2480831551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73814a6d0 msgr2=0x7fd7380b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 --2- 172.21.15.31:0/2480831551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73814a6d0 0x7fd7380b5a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd728009870 tx=0x7fd72802b860 comp rx=0 tx=0).stop 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 -- 172.21.15.31:0/2480831551 shutdown_connections 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 --2- 172.21.15.31:0/2480831551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd73814a6d0 0x7fd7380b5a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 --2- 172.21.15.31:0/2480831551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380732e0 0x7fd7380ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 -- 172.21.15.31:0/2480831551 >> 172.21.15.31:0/2480831551 conn(0x7fd73806ba20 msgr2=0x7fd73806be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 -- 172.21.15.31:0/2480831551 shutdown_connections 2024-03-23T23:56:33.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.128+0000 7fd73de00640 1 -- 172.21.15.31:0/2480831551 wait complete. 2024-03-23T23:56:33.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.130+0000 7fd73de00640 1 Processor -- start 2024-03-23T23:56:33.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.130+0000 7fd73de00640 1 -- start start 2024-03-23T23:56:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7380732e0 0x7fd7381e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73de00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380b4800 0x7fd7381e03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd73814a6d0 0x7fd7381dcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73de00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7381414c0 con 0x7fd73814a6d0 2024-03-23T23:56:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380adc80 con 0x7fd7380732e0 2024-03-23T23:56:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73de00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd738141640 con 0x7fd7380b4800 2024-03-23T23:56:33.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd73814a6d0 0x7fd7381dcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd73814a6d0 0x7fd7381dcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44322/0 (socket says 172.21.15.31:44322) 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73d400640 1 -- 172.21.15.31:0/296659922 learned_addr learned my addr 172.21.15.31:0/296659922 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd737e00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380b4800 0x7fd7381e03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.131+0000 7fd73ca00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7380732e0 0x7fd7381e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73d400640 1 -- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380b4800 msgr2=0x7fd7381e03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73d400640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380b4800 0x7fd7381e03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73d400640 1 -- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7380732e0 msgr2=0x7fd7381e0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73d400640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7380732e0 0x7fd7381e0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73d400640 1 -- 172.21.15.31:0/296659922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b21d0 con 0x7fd73814a6d0 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd737e00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380b4800 0x7fd7381e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73ca00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7380732e0 0x7fd7381e0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73d400640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd73814a6d0 0x7fd7381dcbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd73000c7a0 tx=0x7fd73000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd734c00640 1 -- 172.21.15.31:0/296659922 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730003b70 con 0x7fd73814a6d0 2024-03-23T23:56:33.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd734c00640 1 -- 172.21.15.31:0/296659922 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730003d30 con 0x7fd73814a6d0 2024-03-23T23:56:33.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd734c00640 1 -- 172.21.15.31:0/296659922 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000aa30 con 0x7fd73814a6d0 2024-03-23T23:56:33.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73806be00 con 0x7fd73814a6d0 2024-03-23T23:56:33.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.132+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7380b1ef0 con 0x7fd73814a6d0 2024-03-23T23:56:33.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.134+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7380b4cd0 con 0x7fd73814a6d0 2024-03-23T23:56:33.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.134+0000 7fd734c00640 1 -- 172.21.15.31:0/296659922 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd73000abd0 con 0x7fd73814a6d0 2024-03-23T23:56:33.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.135+0000 7fd734c00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd71c06bbd0 0x7fd71c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:33.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.135+0000 7fd734c00640 1 -- 172.21.15.31:0/296659922 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd73008a980 con 0x7fd73814a6d0 2024-03-23T23:56:33.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.136+0000 7fd73ca00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd71c06bbd0 0x7fd71c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:33.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.137+0000 7fd73ca00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd71c06bbd0 0x7fd71c06e090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009ac0 tx=0x7fd72c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:33.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.139+0000 7fd734c00640 1 -- 172.21.15.31:0/296659922 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd7380b4cd0 con 0x7fd73814a6d0 2024-03-23T23:56:33.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.381+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd7380752c0 con 0x7fd73814a6d0 2024-03-23T23:56:33.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.888+0000 7fd734c00640 1 -- 172.21.15.31:0/296659922 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd730059460 con 0x7fd73814a6d0 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.891+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd71c06bbd0 msgr2=0x7fd71c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.891+0000 7fd73de00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd71c06bbd0 0x7fd71c06e090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009ac0 tx=0x7fd72c008040 comp rx=0 tx=0).stop 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.891+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd73814a6d0 msgr2=0x7fd7381dcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.891+0000 7fd73de00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd73814a6d0 0x7fd7381dcbc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd73000c7a0 tx=0x7fd73000cc60 comp rx=0 tx=0).stop 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 shutdown_connections 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd71c06bbd0 0x7fd71c06e090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd73814a6d0 0x7fd7381dcbc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7380b4800 0x7fd7381e03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 --2- 172.21.15.31:0/296659922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7380732e0 0x7fd7381e0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:33.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 >> 172.21.15.31:0/296659922 conn(0x7fd73806ba20 msgr2=0x7fd7380b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:33.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 shutdown_connections 2024-03-23T23:56:33.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:33.892+0000 7fd73de00640 1 -- 172.21.15.31:0/296659922 wait complete. 2024-03-23T23:56:33.913 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-23T23:56:33.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:56:34.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.133+0000 7f500e200640 1 Processor -- start 2024-03-23T23:56:34.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.134+0000 7f500e200640 1 -- start start 2024-03-23T23:56:34.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.135+0000 7f500e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50080b4e00 0x7f50080af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.135+0000 7f500e200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f500814aa40 0x7f5008147620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.135+0000 7f500e200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080ae7e0 con 0x7f50080b5780 2024-03-23T23:56:34.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.135+0000 7f500e200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080b4970 con 0x7f500814aa40 2024-03-23T23:56:34.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.135+0000 7f500e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080b5b60 con 0x7f50080b4e00 2024-03-23T23:56:34.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.135+0000 7f5007e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f500814aa40 0x7f5008147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.136+0000 7f5007e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f500814aa40 0x7f5008147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44326/0 (socket says 172.21.15.31:44326) 2024-03-23T23:56:34.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.136+0000 7f5007e00640 1 -- 172.21.15.31:0/1750406279 learned_addr learned my addr 172.21.15.31:0/1750406279 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:34.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.136+0000 7f5006a00640 1 --2- 172.21.15.31:0/1750406279 >> v2:172.21.15.59:3300/0 conn(0x7f50080b4e00 0x7f50080af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.136+0000 7f5007e00640 1 -- 172.21.15.31:0/1750406279 >> v2:172.21.15.59:3300/0 conn(0x7f50080b4e00 msgr2=0x7f50080af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:34.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.136+0000 7f5007e00640 1 --2- 172.21.15.31:0/1750406279 >> v2:172.21.15.59:3300/0 conn(0x7f50080b4e00 0x7f50080af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.136+0000 7f5007e00640 1 -- 172.21.15.31:0/1750406279 >> v1:172.21.15.59:6789/0 conn(0x7f50080b5780 legacy=0x7f50080aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.136+0000 7f5007e00640 1 -- 172.21.15.31:0/1750406279 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080aea80 con 0x7f500814aa40 2024-03-23T23:56:34.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.138+0000 7f5007e00640 1 --2- 172.21.15.31:0/1750406279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f5008147620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50080ae9b0 tx=0x7f500002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14c2cfafb0cd8bb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:34.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.138+0000 7f5006000640 1 -- 172.21.15.31:0/1750406279 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500002e070 con 0x7f500814aa40 2024-03-23T23:56:34.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.138+0000 7f5006000640 1 -- 172.21.15.31:0/1750406279 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5000037070 con 0x7f500814aa40 2024-03-23T23:56:34.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.138+0000 7f5006000640 1 -- 172.21.15.31:0/1750406279 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000031a00 con 0x7f500814aa40 2024-03-23T23:56:34.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 -- 172.21.15.31:0/1750406279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 msgr2=0x7f5008147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 --2- 172.21.15.31:0/1750406279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f5008147620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50080ae9b0 tx=0x7f500002b880 comp rx=0 tx=0).stop 2024-03-23T23:56:34.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 -- 172.21.15.31:0/1750406279 shutdown_connections 2024-03-23T23:56:34.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 --2- 172.21.15.31:0/1750406279 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f5008147620 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 --2- 172.21.15.31:0/1750406279 >> v2:172.21.15.59:3300/0 conn(0x7f50080b4e00 0x7f50080af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 -- 172.21.15.31:0/1750406279 >> 172.21.15.31:0/1750406279 conn(0x7f5008066fe0 msgr2=0x7f50080673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:34.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 -- 172.21.15.31:0/1750406279 shutdown_connections 2024-03-23T23:56:34.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.139+0000 7f500e200640 1 -- 172.21.15.31:0/1750406279 wait complete. 2024-03-23T23:56:34.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.141+0000 7f500e200640 1 Processor -- start 2024-03-23T23:56:34.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.141+0000 7f500e200640 1 -- start start 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f500e200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50080b4e00 0x7f50080b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f500e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50080b5780 0x7f5008070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f500e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f500806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f500e200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008147ce0 con 0x7f500814aa40 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f500e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5008147b60 con 0x7f50080b5780 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f500e200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5008147e60 con 0x7f50080b4e00 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f500806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f500806ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44340/0 (socket says 172.21.15.31:44340) 2024-03-23T23:56:34.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 -- 172.21.15.31:0/1894880079 learned_addr learned my addr 172.21.15.31:0/1894880079 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5006a00640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50080b5780 0x7f5008070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007400640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50080b4e00 0x7f50080b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 -- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50080b4e00 msgr2=0x7f50080b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50080b4e00 0x7f50080b6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 -- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50080b5780 msgr2=0x7f5008070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50080b5780 0x7f5008070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.142+0000 7f5007e00640 1 -- 172.21.15.31:0/1894880079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5008121ae0 con 0x7f500814aa40 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.143+0000 7f5007e00640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f500806ee70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f50000090b0 tx=0x7f50000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.143+0000 7f4fff400640 1 -- 172.21.15.31:0/1894880079 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000032670 con 0x7f500814aa40 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.143+0000 7f4fff400640 1 -- 172.21.15.31:0/1894880079 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5000032810 con 0x7f500814aa40 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.143+0000 7f4fff400640 1 -- 172.21.15.31:0/1894880079 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000032c00 con 0x7f500814aa40 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.143+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50081e0130 con 0x7f500814aa40 2024-03-23T23:56:34.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.143+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50081e06f0 con 0x7f500814aa40 2024-03-23T23:56:34.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.145+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500804f400 con 0x7f500814aa40 2024-03-23T23:56:34.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.145+0000 7f4fff400640 1 -- 172.21.15.31:0/1894880079 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f50000453f0 con 0x7f500814aa40 2024-03-23T23:56:34.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.146+0000 7f4fff400640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4fe406bc20 0x7f4fe406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.146+0000 7f4fff400640 1 -- 172.21.15.31:0/1894880079 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50000ac890 con 0x7f500814aa40 2024-03-23T23:56:34.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.147+0000 7f5007400640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4fe406bc20 0x7f4fe406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.148+0000 7f5007400640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4fe406bc20 0x7f4fe406e0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8000f60 tx=0x7f4ff8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:34.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.151+0000 7f4fff400640 1 -- 172.21.15.31:0/1894880079 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f5000040070 con 0x7f500814aa40 2024-03-23T23:56:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.392+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5008070180 con 0x7f500814aa40 2024-03-23T23:56:34.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.393+0000 7f4fff400640 1 -- 172.21.15.31:0/1894880079 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3388 (secure 0 0 0) 0x7f500007b480 con 0x7f500814aa40 2024-03-23T23:56:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:34.393 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/481677666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":481677666},{"type":"v1","addr":"172.21.15.31:6833","nonce":481677666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:56:30.337777+0000","modified":"2024-03-23T23:56:33.383201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3774186650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3774186650},{"type":"v1","addr":"172.21.15.59:6835","nonce":3774186650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-03-23T23:56:34.394 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.395+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4fe406bc20 msgr2=0x7f4fe406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4fe406bc20 0x7f4fe406e0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8000f60 tx=0x7f4ff8009040 comp rx=0 tx=0).stop 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 msgr2=0x7f500806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f500806ee70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f50000090b0 tx=0x7f50000046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 shutdown_connections 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4fe406bc20 0x7f4fe406e0e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50080b5780 0x7f5008070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f500814aa40 0x7f500806ee70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 --2- 172.21.15.31:0/1894880079 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50080b4e00 0x7f50080b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 >> 172.21.15.31:0/1894880079 conn(0x7f5008066fe0 msgr2=0x7f5008147330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:34.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 shutdown_connections 2024-03-23T23:56:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.396+0000 7f500e200640 1 -- 172.21.15.31:0/1894880079 wait complete. 2024-03-23T23:56:34.416 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:34.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.635+0000 7f5056a00640 1 Processor -- start 2024-03-23T23:56:34.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.635+0000 7f5056a00640 1 -- start start 2024-03-23T23:56:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f5056a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f505014f900 0x7f50500b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f5056a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50500b5990 0x7f5050156100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f5056a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5050145f20 con 0x7f50500b5510 2024-03-23T23:56:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f5056a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50500b12d0 con 0x7f505014f900 2024-03-23T23:56:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f5056a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505014fce0 con 0x7f50500b5990 2024-03-23T23:56:34.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f504fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f505014f900 0x7f50500b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f504fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f505014f900 0x7f50500b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60842/0 (socket says 172.21.15.31:60842) 2024-03-23T23:56:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.636+0000 7f504fe00640 1 -- 172.21.15.31:0/10296657 learned_addr learned my addr 172.21.15.31:0/10296657 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.637+0000 7f5054a00640 1 --2- 172.21.15.31:0/10296657 >> v2:172.21.15.59:3300/0 conn(0x7f50500b5990 0x7f5050156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.637+0000 7f504fe00640 1 -- 172.21.15.31:0/10296657 >> v2:172.21.15.59:3300/0 conn(0x7f50500b5990 msgr2=0x7f5050156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.637+0000 7f504fe00640 1 --2- 172.21.15.31:0/10296657 >> v2:172.21.15.59:3300/0 conn(0x7f50500b5990 0x7f5050156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.637+0000 7f504fe00640 1 -- 172.21.15.31:0/10296657 >> v1:172.21.15.31:6789/0 conn(0x7f50500b5510 legacy=0x7f50500b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.637+0000 7f504fe00640 1 -- 172.21.15.31:0/10296657 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500b4950 con 0x7f505014f900 2024-03-23T23:56:34.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.638+0000 7f504fe00640 1 --2- 172.21.15.31:0/10296657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505014f900 0x7f50500b0580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f505014b780 tx=0x7f504002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2144bb3bc9d6fd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.638+0000 7f504f400640 1 -- 172.21.15.31:0/10296657 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040035020 con 0x7f505014f900 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.638+0000 7f504f400640 1 -- 172.21.15.31:0/10296657 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040031870 con 0x7f505014f900 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.638+0000 7f504f400640 1 -- 172.21.15.31:0/10296657 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040031c40 con 0x7f505014f900 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 -- 172.21.15.31:0/10296657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505014f900 msgr2=0x7f50500b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 --2- 172.21.15.31:0/10296657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505014f900 0x7f50500b0580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f505014b780 tx=0x7f504002b910 comp rx=0 tx=0).stop 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 -- 172.21.15.31:0/10296657 shutdown_connections 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 --2- 172.21.15.31:0/10296657 >> v2:172.21.15.59:3300/0 conn(0x7f50500b5990 0x7f5050156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 --2- 172.21.15.31:0/10296657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505014f900 0x7f50500b0580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 -- 172.21.15.31:0/10296657 >> 172.21.15.31:0/10296657 conn(0x7f5050066fe0 msgr2=0x7f50500673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 -- 172.21.15.31:0/10296657 shutdown_connections 2024-03-23T23:56:34.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.639+0000 7f5056a00640 1 -- 172.21.15.31:0/10296657 wait complete. 2024-03-23T23:56:34.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.641+0000 7f5056a00640 1 Processor -- start 2024-03-23T23:56:34.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.641+0000 7f5056a00640 1 -- start start 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.641+0000 7f5056a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50500b5510 0x7f5050149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.641+0000 7f5056a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50500b5990 0x7f50501e4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.641+0000 7f5056a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505014f900 0x7f5050141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.641+0000 7f5056a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500b4eb0 con 0x7f50500b5510 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.641+0000 7f5056a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500b28b0 con 0x7f50500b5990 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f5056a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50500b5030 con 0x7f505014f900 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50500b5510 0x7f5050149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50500b5510 0x7f5050149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60844/0 (socket says 172.21.15.31:60844) 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 -- 172.21.15.31:0/3952732468 learned_addr learned my addr 172.21.15.31:0/3952732468 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f5054a00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505014f900 0x7f5050141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f5047e00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50500b5990 0x7f50501e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 -- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505014f900 msgr2=0x7f5050141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505014f900 0x7f5050141100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 -- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50500b5990 msgr2=0x7f50501e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50500b5990 0x7f50501e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.642+0000 7f504fe00640 1 -- 172.21.15.31:0/3952732468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505006f1f0 con 0x7f50500b5510 2024-03-23T23:56:34.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.643+0000 7f504fe00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50500b5510 0x7f5050149240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f504002b950 tx=0x7f50400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.643+0000 7f504cc00640 1 -- 172.21.15.31:0/3952732468 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040040070 con 0x7f50500b5510 2024-03-23T23:56:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.643+0000 7f504cc00640 1 -- 172.21.15.31:0/3952732468 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040030d00 con 0x7f50500b5510 2024-03-23T23:56:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.643+0000 7f504cc00640 1 -- 172.21.15.31:0/3952732468 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040035040 con 0x7f50500b5510 2024-03-23T23:56:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.643+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f505014af90 con 0x7f50500b5510 2024-03-23T23:56:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.643+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f505014b270 con 0x7f50500b5510 2024-03-23T23:56:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.644+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f505004f400 con 0x7f50500b5510 2024-03-23T23:56:34.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.645+0000 7f504cc00640 1 -- 172.21.15.31:0/3952732468 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f504004b060 con 0x7f50500b5510 2024-03-23T23:56:34.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.646+0000 7f504cc00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f502c06bbd0 0x7f502c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:34.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.646+0000 7f504cc00640 1 -- 172.21.15.31:0/3952732468 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50400ac740 con 0x7f50500b5510 2024-03-23T23:56:34.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.647+0000 7f5047e00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f502c06bbd0 0x7f502c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:34.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.648+0000 7f5047e00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f502c06bbd0 0x7f502c06e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5050149c20 tx=0x7f5038009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:34.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.650+0000 7f504cc00640 1 -- 172.21.15.31:0/3952732468 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f504007b2c0 con 0x7f50500b5510 2024-03-23T23:56:34.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.853+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f505014eb50 con 0x7f50500b5510 2024-03-23T23:56:34.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.855+0000 7f504cc00640 1 -- 172.21.15.31:0/3952732468 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f504007abc0 con 0x7f50500b5510 2024-03-23T23:56:34.855 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:34.855 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:31.864837+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:34.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.857+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f502c06bbd0 msgr2=0x7f502c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.857+0000 7f5056a00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f502c06bbd0 0x7f502c06e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5050149c20 tx=0x7f5038009040 comp rx=0 tx=0).stop 2024-03-23T23:56:34.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.857+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50500b5510 msgr2=0x7f5050149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50500b5510 0x7f5050149240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f504002b950 tx=0x7f50400046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 shutdown_connections 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f502c06bbd0 0x7f502c06e090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50500b5990 0x7f50501e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505014f900 0x7f5050141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 --2- 172.21.15.31:0/3952732468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50500b5510 0x7f5050149240 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 >> 172.21.15.31:0/3952732468 conn(0x7f5050066fe0 msgr2=0x7f50500b70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 shutdown_connections 2024-03-23T23:56:34.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:34.858+0000 7f5056a00640 1 -- 172.21.15.31:0/3952732468 wait complete. 2024-03-23T23:56:34.878 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-23T23:56:34.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:56:35.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.069+0000 7f1a80a00640 1 Processor -- start 2024-03-23T23:56:35.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.070+0000 7f1a80a00640 1 -- start start 2024-03-23T23:56:35.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a80a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a7c0b5210 0x7f1a7c14a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a80a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a7c0b9850 0x7f1a7c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a80a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7c0b3e60 con 0x7f1a7c0b6bc0 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a80a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b55f0 con 0x7f1a7c0b5210 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a80a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b9dc0 con 0x7f1a7c0b9850 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a7a800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a7c0b5210 0x7f1a7c14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a7a800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1a7c0b5210 0x7f1a7c14a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60860/0 (socket says 172.21.15.31:60860) 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a7a800640 1 -- 172.21.15.31:0/3688862883 learned_addr learned my addr 172.21.15.31:0/3688862883 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a7a800640 1 -- 172.21.15.31:0/3688862883 >> v2:172.21.15.59:3300/0 conn(0x7f1a7c0b9850 msgr2=0x7f1a7c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.071+0000 7f1a79e00640 1 --2- 172.21.15.31:0/3688862883 >> v2:172.21.15.59:3300/0 conn(0x7f1a7c0b9850 0x7f1a7c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.072+0000 7f1a7a800640 1 --2- 172.21.15.31:0/3688862883 >> v2:172.21.15.59:3300/0 conn(0x7f1a7c0b9850 0x7f1a7c14ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.072+0000 7f1a7a800640 1 -- 172.21.15.31:0/3688862883 >> v1:172.21.15.59:6789/0 conn(0x7f1a7c0b6bc0 legacy=0x7f1a7c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:35.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.072+0000 7f1a7a800640 1 -- 172.21.15.31:0/3688862883 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0b4100 con 0x7f1a7c0b5210 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.073+0000 7f1a7a800640 1 --2- 172.21.15.31:0/3688862883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b5210 0x7f1a7c14a850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0b8a80 tx=0x7f1a6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb7f76984c8e228 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.073+0000 7f1a79400640 1 -- 172.21.15.31:0/3688862883 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64035020 con 0x7f1a7c0b5210 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.073+0000 7f1a79400640 1 -- 172.21.15.31:0/3688862883 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64031870 con 0x7f1a7c0b5210 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.073+0000 7f1a79400640 1 -- 172.21.15.31:0/3688862883 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64031c40 con 0x7f1a7c0b5210 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 -- 172.21.15.31:0/3688862883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b5210 msgr2=0x7f1a7c14a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 --2- 172.21.15.31:0/3688862883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b5210 0x7f1a7c14a850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0b8a80 tx=0x7f1a6402b910 comp rx=0 tx=0).stop 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 -- 172.21.15.31:0/3688862883 shutdown_connections 2024-03-23T23:56:35.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 --2- 172.21.15.31:0/3688862883 >> v2:172.21.15.59:3300/0 conn(0x7f1a7c0b9850 0x7f1a7c14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 --2- 172.21.15.31:0/3688862883 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b5210 0x7f1a7c14a850 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 -- 172.21.15.31:0/3688862883 >> 172.21.15.31:0/3688862883 conn(0x7f1a7c066fb0 msgr2=0x7f1a7c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:35.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 -- 172.21.15.31:0/3688862883 shutdown_connections 2024-03-23T23:56:35.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.074+0000 7f1a80a00640 1 -- 172.21.15.31:0/3688862883 wait complete. 2024-03-23T23:56:35.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.075+0000 7f1a80a00640 1 Processor -- start 2024-03-23T23:56:35.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.075+0000 7f1a80a00640 1 -- start start 2024-03-23T23:56:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.076+0000 7f1a80a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a7c0b5210 0x7f1a7c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.076+0000 7f1a80a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a7c0b6bc0 0x7f1a7c13d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.076+0000 7f1a80a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b9850 0x7f1a7c13de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.076+0000 7f1a80a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b7c70 con 0x7f1a7c0b9850 2024-03-23T23:56:35.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.076+0000 7f1a80a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b7af0 con 0x7f1a7c0b5210 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.076+0000 7f1a80a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b7df0 con 0x7f1a7c0b6bc0 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b9850 0x7f1a7c13de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a7c0b5210 0x7f1a7c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b9850 0x7f1a7c13de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60874/0 (socket says 172.21.15.31:60874) 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 -- 172.21.15.31:0/808938728 learned_addr learned my addr 172.21.15.31:0/808938728 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a79e00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a7c0b6bc0 0x7f1a7c13d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 -- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a7c0b6bc0 msgr2=0x7f1a7c13d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a7c0b6bc0 0x7f1a7c13d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 -- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a7c0b5210 msgr2=0x7f1a7c1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a7c0b5210 0x7f1a7c1498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 -- 172.21.15.31:0/808938728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c13ec60 con 0x7f1a7c0b9850 2024-03-23T23:56:35.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.077+0000 7f1a7b200640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b9850 0x7f1a7c13de10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c780 tx=0x7f1a7400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.078+0000 7f1a72a00640 1 -- 172.21.15.31:0/808938728 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74017070 con 0x7f1a7c0b9850 2024-03-23T23:56:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.078+0000 7f1a72a00640 1 -- 172.21.15.31:0/808938728 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74003da0 con 0x7f1a7c0b9850 2024-03-23T23:56:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.078+0000 7f1a72a00640 1 -- 172.21.15.31:0/808938728 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740052b0 con 0x7f1a7c0b9850 2024-03-23T23:56:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.078+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c13e4f0 con 0x7f1a7c0b9850 2024-03-23T23:56:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.078+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c13bf90 con 0x7f1a7c0b9850 2024-03-23T23:56:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.079+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c0752c0 con 0x7f1a7c0b9850 2024-03-23T23:56:35.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.080+0000 7f1a72a00640 1 -- 172.21.15.31:0/808938728 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1a7401a070 con 0x7f1a7c0b9850 2024-03-23T23:56:35.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.081+0000 7f1a72a00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1a5806bbd0 0x7f1a5806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.082+0000 7f1a72a00640 1 -- 172.21.15.31:0/808938728 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a7408a060 con 0x7f1a7c0b9850 2024-03-23T23:56:35.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.082+0000 7f1a7a800640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1a5806bbd0 0x7f1a5806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.083+0000 7f1a7a800640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1a5806bbd0 0x7f1a5806e090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a64036000 tx=0x7f1a6403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.086+0000 7f1a72a00640 1 -- 172.21.15.31:0/808938728 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f1a740584f0 con 0x7f1a7c0b9850 2024-03-23T23:56:35.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.273+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a7c13c1d0 con 0x7f1a5806bbd0 2024-03-23T23:56:35.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.316+0000 7f1a72a00640 1 -- 172.21.15.31:0/808938728 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237115 (secure 0 0 0) 0x7f1a7c13c1d0 con 0x7f1a5806bbd0 2024-03-23T23:56:35.317 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:35.332 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:56:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.321+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1a5806bbd0 msgr2=0x7f1a5806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1a5806bbd0 0x7f1a5806e090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a64036000 tx=0x7f1a6403c040 comp rx=0 tx=0).stop 2024-03-23T23:56:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b9850 msgr2=0x7f1a7c13de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b9850 0x7f1a7c13de10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400c780 tx=0x7f1a7400cc40 comp rx=0 tx=0).stop 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 shutdown_connections 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1a5806bbd0 0x7f1a5806e090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1a7c0b9850 0x7f1a7c13de10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a7c0b6bc0 0x7f1a7c13d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 --2- 172.21.15.31:0/808938728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a7c0b5210 0x7f1a7c1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 >> 172.21.15.31:0/808938728 conn(0x7f1a7c066fb0 msgr2=0x7f1a7c0bd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 shutdown_connections 2024-03-23T23:56:35.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.322+0000 7f1a80a00640 1 -- 172.21.15.31:0/808938728 wait complete. 2024-03-23T23:56:35.340 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-23T23:56:33.319263+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219392,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755328,"statfs":{"total":773094113280,"available":772869455872,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.483129"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-23T23:56:25.080553+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:56:25.080553+0000","last_peered":"2024-03-23T23:56:25.080553+0000","last_clean":"2024-03-23T23:56:25.080553+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:56:25.080553+0000","last_undegraded":"2024-03-23T23:56:25.080553+0000","last_fullsized":"2024-03-23T23:56:25.080553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:29.833606+0000","last_change":"2024-03-23T23:56:29.833606+0000","last_active":"2024-03-23T23:56:29.833606+0000","last_peered":"2024-03-23T23:56:29.833606+0000","last_clean":"2024-03-23T23:56:29.833606+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:29.833606+0000","last_undegraded":"2024-03-23T23:56:29.833606+0000","last_fullsized":"2024-03-23T23:56:29.833606+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-23T23:56:28.817528+0000","last_change":"2024-03-23T23:56:28.817528+0000","last_active":"2024-03-23T23:56:28.817528+0000","last_peered":"2024-03-23T23:56:28.817528+0000","last_clean":"2024-03-23T23:56:28.817528+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-23T23:56:28.817528+0000","last_undegraded":"2024-03-23T23:56:28.817528+0000","last_fullsized":"2024-03-23T23:56:28.817528+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:56:35.347 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:56:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.604+0000 7f5ce4400640 1 Processor -- start 2024-03-23T23:56:35.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.604+0000 7f5ce4400640 1 -- start start 2024-03-23T23:56:35.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5ce4400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cdc0b5a70 0x7f5cdc145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5ce4400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0b5e50 con 0x7f5cdc0b27e0 2024-03-23T23:56:35.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5ce4400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc145240 con 0x7f5cdc06eeb0 2024-03-23T23:56:35.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5ce4400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc145890 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5ce1000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5cdc0b27e0 0x7f5cdc13f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59386/0 (socket says 172.21.15.31:59386) 2024-03-23T23:56:35.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5ce1000640 1 -- 172.21.15.31:0/3839794262 learned_addr learned my addr 172.21.15.31:0/3839794262 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:35.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5ce1a00640 1 --2- 172.21.15.31:0/3839794262 >> v2:172.21.15.59:3300/0 conn(0x7f5cdc0b5a70 0x7f5cdc145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.606+0000 7f5cdbe00640 1 -- 172.21.15.31:0/3839794262 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254686578 0 0) 0x7f5cdc0b5e50 con 0x7f5cdc0b27e0 2024-03-23T23:56:35.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.607+0000 7f5cdbe00640 1 -- 172.21.15.31:0/3839794262 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc4003520 con 0x7f5cdc0b27e0 2024-03-23T23:56:35.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.607+0000 7f5cdbe00640 1 -- 172.21.15.31:0/3839794262 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359798142 0 0) 0x7f5cc4003520 con 0x7f5cdc0b27e0 2024-03-23T23:56:35.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.607+0000 7f5ce1a00640 1 -- 172.21.15.31:0/3839794262 >> v1:172.21.15.59:6789/0 conn(0x7f5cdc06eeb0 legacy=0x7f5cdc14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.607+0000 7f5ce1a00640 1 -- 172.21.15.31:0/3839794262 >> v1:172.21.15.31:6789/0 conn(0x7f5cdc0b27e0 legacy=0x7f5cdc13f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.607+0000 7f5ce1a00640 1 -- 172.21.15.31:0/3839794262 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc145520 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.608+0000 7f5ce1a00640 1 --2- 172.21.15.31:0/3839794262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc145d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00097a0 tx=0x7f5cd002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c47de001385888 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5cdbe00640 1 -- 172.21.15.31:0/3839794262 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0038070 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5cdbe00640 1 -- 172.21.15.31:0/3839794262 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd0031500 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5cdbe00640 1 -- 172.21.15.31:0/3839794262 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8001670 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5ce4400640 1 -- 172.21.15.31:0/3839794262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc0b5a70 msgr2=0x7f5cdc145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5ce4400640 1 --2- 172.21.15.31:0/3839794262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc145d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00097a0 tx=0x7f5cd002b820 comp rx=0 tx=0).stop 2024-03-23T23:56:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5ce4400640 1 -- 172.21.15.31:0/3839794262 shutdown_connections 2024-03-23T23:56:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5ce4400640 1 --2- 172.21.15.31:0/3839794262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc145d20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5ce4400640 1 -- 172.21.15.31:0/3839794262 >> 172.21.15.31:0/3839794262 conn(0x7f5cdc066fb0 msgr2=0x7f5cdc0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:35.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.609+0000 7f5ce4400640 1 -- 172.21.15.31:0/3839794262 shutdown_connections 2024-03-23T23:56:35.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.610+0000 7f5ce4400640 1 -- 172.21.15.31:0/3839794262 wait complete. 2024-03-23T23:56:35.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.611+0000 7f5ce4400640 1 Processor -- start 2024-03-23T23:56:35.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.611+0000 7f5ce4400640 1 -- start start 2024-03-23T23:56:35.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce4400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc06eeb0 0x7f5cdc0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce4400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cdc0b27e0 0x7f5cdc146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce4400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce4400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc13f890 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce4400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc13f710 con 0x7f5cdc06eeb0 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce4400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0708f0 con 0x7f5cdc0b27e0 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce2400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce2400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc146860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60882/0 (socket says 172.21.15.31:60882) 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce2400640 1 -- 172.21.15.31:0/883613671 learned_addr learned my addr 172.21.15.31:0/883613671 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.612+0000 7f5ce1a00640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc06eeb0 0x7f5cdc0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce1000640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cdc0b27e0 0x7f5cdc146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce2400640 1 -- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cdc0b27e0 msgr2=0x7f5cdc146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce2400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cdc0b27e0 0x7f5cdc146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce2400640 1 -- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc06eeb0 msgr2=0x7f5cdc0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce2400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc06eeb0 0x7f5cdc0b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce2400640 1 -- 172.21.15.31:0/883613671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc140c90 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce1000640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cdc0b27e0 0x7f5cdc146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:35.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce2400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc146860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400c7a0 tx=0x7f5cd400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5cd9600640 1 -- 172.21.15.31:0/883613671 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4003b70 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5cd9600640 1 -- 172.21.15.31:0/883613671 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd4003d30 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5cd9600640 1 -- 172.21.15.31:0/883613671 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd400aa90 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.613+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc13faa0 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.614+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc148ea0 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.615+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc04f400 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.616+0000 7f5cd9600640 1 -- 172.21.15.31:0/883613671 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5cd400ac30 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.616+0000 7f5cd9600640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5cbc06bbd0 0x7f5cbc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:35.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.617+0000 7f5cd9600640 1 -- 172.21.15.31:0/883613671 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cd408a920 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.617+0000 7f5ce1a00640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5cbc06bbd0 0x7f5cbc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:35.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.618+0000 7f5ce1a00640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5cbc06bbd0 0x7f5cbc06e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0035000 tx=0x7f5cd0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:35.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.621+0000 7f5cd9600640 1 -- 172.21.15.31:0/883613671 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f5cd40594a0 con 0x7f5cdc0b5a70 2024-03-23T23:56:35.816 INFO:tasks.ceph.mds.b.smithi059.stderr:2024-03-23T23:56:35.817+0000 7fe94ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-23T23:56:35.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.818+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5cdc072460 con 0x7f5cbc06bbd0 2024-03-23T23:56:35.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.859+0000 7f5cd9600640 1 -- 172.21.15.31:0/883613671 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251948 (secure 0 0 0) 0x7f5cdc072460 con 0x7f5cbc06bbd0 2024-03-23T23:56:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:35.864 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:56:35.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5cbc06bbd0 msgr2=0x7f5cbc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5cbc06bbd0 0x7f5cbc06e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0035000 tx=0x7f5cd0008030 comp rx=0 tx=0).stop 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cdc0b5a70 msgr2=0x7f5cdc146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc146860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400c7a0 tx=0x7f5cd400cc60 comp rx=0 tx=0).stop 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 shutdown_connections 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5cbc06bbd0 0x7f5cbc06e090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cdc0b5a70 0x7f5cdc146860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cdc0b27e0 0x7f5cdc146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 --2- 172.21.15.31:0/883613671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cdc06eeb0 0x7f5cdc0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 >> 172.21.15.31:0/883613671 conn(0x7f5cdc066fb0 msgr2=0x7f5cdc0b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 shutdown_connections 2024-03-23T23:56:35.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:35.865+0000 7f5ce4400640 1 -- 172.21.15.31:0/883613671 wait complete. 2024-03-23T23:56:35.884 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-23T23:56:35.319812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001955"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880786+0000","last_change":"2024-03-23T23:56:30.885878+0000","last_active":"2024-03-23T23:56:31.880786+0000","last_peered":"2024-03-23T23:56:31.880786+0000","last_clean":"2024-03-23T23:56:31.880786+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:56:31.880786+0000","last_undegraded":"2024-03-23T23:56:31.880786+0000","last_fullsized":"2024-03-23T23:56:31.880786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886363+0000","last_change":"2024-03-23T23:56:30.875303+0000","last_active":"2024-03-23T23:56:31.886363+0000","last_peered":"2024-03-23T23:56:31.886363+0000","last_clean":"2024-03-23T23:56:31.886363+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:56:31.886363+0000","last_undegraded":"2024-03-23T23:56:31.886363+0000","last_fullsized":"2024-03-23T23:56:31.886363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257583+0000","last_change":"2024-03-23T23:56:30.883893+0000","last_active":"2024-03-23T23:56:32.257583+0000","last_peered":"2024-03-23T23:56:32.257583+0000","last_clean":"2024-03-23T23:56:32.257583+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:56:32.257583+0000","last_undegraded":"2024-03-23T23:56:32.257583+0000","last_fullsized":"2024-03-23T23:56:32.257583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254511+0000","last_change":"2024-03-23T23:56:30.891008+0000","last_active":"2024-03-23T23:56:32.254511+0000","last_peered":"2024-03-23T23:56:32.254511+0000","last_clean":"2024-03-23T23:56:32.254511+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:56:32.254511+0000","last_undegraded":"2024-03-23T23:56:32.254511+0000","last_fullsized":"2024-03-23T23:56:32.254511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880448+0000","last_change":"2024-03-23T23:56:30.877242+0000","last_active":"2024-03-23T23:56:31.880448+0000","last_peered":"2024-03-23T23:56:31.880448+0000","last_clean":"2024-03-23T23:56:31.880448+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:56:31.880448+0000","last_undegraded":"2024-03-23T23:56:31.880448+0000","last_fullsized":"2024-03-23T23:56:31.880448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254330+0000","last_change":"2024-03-23T23:56:30.890268+0000","last_active":"2024-03-23T23:56:32.254330+0000","last_peered":"2024-03-23T23:56:32.254330+0000","last_clean":"2024-03-23T23:56:32.254330+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:56:32.254330+0000","last_undegraded":"2024-03-23T23:56:32.254330+0000","last_fullsized":"2024-03-23T23:56:32.254330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880096+0000","last_change":"2024-03-23T23:56:30.885059+0000","last_active":"2024-03-23T23:56:31.880096+0000","last_peered":"2024-03-23T23:56:31.880096+0000","last_clean":"2024-03-23T23:56:31.880096+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:56:31.880096+0000","last_undegraded":"2024-03-23T23:56:31.880096+0000","last_fullsized":"2024-03-23T23:56:31.880096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253729+0000","last_change":"2024-03-23T23:56:30.881077+0000","last_active":"2024-03-23T23:56:32.253729+0000","last_peered":"2024-03-23T23:56:32.253729+0000","last_clean":"2024-03-23T23:56:32.253729+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:56:32.253729+0000","last_undegraded":"2024-03-23T23:56:32.253729+0000","last_fullsized":"2024-03-23T23:56:32.253729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881033+0000","last_change":"2024-03-23T23:56:30.883587+0000","last_active":"2024-03-23T23:56:31.881033+0000","last_peered":"2024-03-23T23:56:31.881033+0000","last_clean":"2024-03-23T23:56:31.881033+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:56:31.881033+0000","last_undegraded":"2024-03-23T23:56:31.881033+0000","last_fullsized":"2024-03-23T23:56:31.881033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879573+0000","last_change":"2024-03-23T23:56:30.888454+0000","last_active":"2024-03-23T23:56:31.879573+0000","last_peered":"2024-03-23T23:56:31.879573+0000","last_clean":"2024-03-23T23:56:31.879573+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:56:31.879573+0000","last_undegraded":"2024-03-23T23:56:31.879573+0000","last_fullsized":"2024-03-23T23:56:31.879573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879166+0000","last_change":"2024-03-23T23:56:30.881125+0000","last_active":"2024-03-23T23:56:31.879166+0000","last_peered":"2024-03-23T23:56:31.879166+0000","last_clean":"2024-03-23T23:56:31.879166+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:56:31.879166+0000","last_undegraded":"2024-03-23T23:56:31.879166+0000","last_fullsized":"2024-03-23T23:56:31.879166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879683+0000","last_change":"2024-03-23T23:56:30.863287+0000","last_active":"2024-03-23T23:56:31.879683+0000","last_peered":"2024-03-23T23:56:31.879683+0000","last_clean":"2024-03-23T23:56:31.879683+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:56:31.879683+0000","last_undegraded":"2024-03-23T23:56:31.879683+0000","last_fullsized":"2024-03-23T23:56:31.879683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:00.178139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258712+0000","last_change":"2024-03-23T23:56:30.881169+0000","last_active":"2024-03-23T23:56:32.258712+0000","last_peered":"2024-03-23T23:56:32.258712+0000","last_clean":"2024-03-23T23:56:32.258712+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:56:32.258712+0000","last_undegraded":"2024-03-23T23:56:32.258712+0000","last_fullsized":"2024-03-23T23:56:32.258712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256704+0000","last_change":"2024-03-23T23:56:30.876653+0000","last_active":"2024-03-23T23:56:32.256704+0000","last_peered":"2024-03-23T23:56:32.256704+0000","last_clean":"2024-03-23T23:56:32.256704+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:56:32.256704+0000","last_undegraded":"2024-03-23T23:56:32.256704+0000","last_fullsized":"2024-03-23T23:56:32.256704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:58:31.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885707+0000","last_change":"2024-03-23T23:56:30.862687+0000","last_active":"2024-03-23T23:56:31.885707+0000","last_peered":"2024-03-23T23:56:31.885707+0000","last_clean":"2024-03-23T23:56:31.885707+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:56:31.885707+0000","last_undegraded":"2024-03-23T23:56:31.885707+0000","last_fullsized":"2024-03-23T23:56:31.885707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254454+0000","last_change":"2024-03-23T23:56:30.882976+0000","last_active":"2024-03-23T23:56:32.254454+0000","last_peered":"2024-03-23T23:56:32.254454+0000","last_clean":"2024-03-23T23:56:32.254454+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:56:32.254454+0000","last_undegraded":"2024-03-23T23:56:32.254454+0000","last_fullsized":"2024-03-23T23:56:32.254454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256051+0000","last_change":"2024-03-23T23:56:30.895060+0000","last_active":"2024-03-23T23:56:32.256051+0000","last_peered":"2024-03-23T23:56:32.256051+0000","last_clean":"2024-03-23T23:56:32.256051+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:56:32.256051+0000","last_undegraded":"2024-03-23T23:56:32.256051+0000","last_fullsized":"2024-03-23T23:56:32.256051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255325+0000","last_change":"2024-03-23T23:56:30.892332+0000","last_active":"2024-03-23T23:56:32.255325+0000","last_peered":"2024-03-23T23:56:32.255325+0000","last_clean":"2024-03-23T23:56:32.255325+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:56:32.255325+0000","last_undegraded":"2024-03-23T23:56:32.255325+0000","last_fullsized":"2024-03-23T23:56:32.255325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881381+0000","last_change":"2024-03-23T23:56:30.881290+0000","last_active":"2024-03-23T23:56:31.881381+0000","last_peered":"2024-03-23T23:56:31.881381+0000","last_clean":"2024-03-23T23:56:31.881381+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:56:31.881381+0000","last_undegraded":"2024-03-23T23:56:31.881381+0000","last_fullsized":"2024-03-23T23:56:31.881381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:54:18.265054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879417+0000","last_change":"2024-03-23T23:56:30.875425+0000","last_active":"2024-03-23T23:56:31.879417+0000","last_peered":"2024-03-23T23:56:31.879417+0000","last_clean":"2024-03-23T23:56:31.879417+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:56:31.879417+0000","last_undegraded":"2024-03-23T23:56:31.879417+0000","last_fullsized":"2024-03-23T23:56:31.879417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257198+0000","last_change":"2024-03-23T23:56:30.884434+0000","last_active":"2024-03-23T23:56:32.257198+0000","last_peered":"2024-03-23T23:56:32.257198+0000","last_clean":"2024-03-23T23:56:32.257198+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:56:32.257198+0000","last_undegraded":"2024-03-23T23:56:32.257198+0000","last_fullsized":"2024-03-23T23:56:32.257198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254512+0000","last_change":"2024-03-23T23:56:30.892649+0000","last_active":"2024-03-23T23:56:32.254512+0000","last_peered":"2024-03-23T23:56:32.254512+0000","last_clean":"2024-03-23T23:56:32.254512+0000","last_became_active":"2024-03-23T23:56:30.891572+0000","last_became_peered":"2024-03-23T23:56:30.891572+0000","last_unstale":"2024-03-23T23:56:32.254512+0000","last_undegraded":"2024-03-23T23:56:32.254512+0000","last_fullsized":"2024-03-23T23:56:32.254512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253862+0000","last_change":"2024-03-23T23:56:30.888046+0000","last_active":"2024-03-23T23:56:32.253862+0000","last_peered":"2024-03-23T23:56:32.253862+0000","last_clean":"2024-03-23T23:56:32.253862+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:56:32.253862+0000","last_undegraded":"2024-03-23T23:56:32.253862+0000","last_fullsized":"2024-03-23T23:56:32.253862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254485+0000","last_change":"2024-03-23T23:56:30.886470+0000","last_active":"2024-03-23T23:56:32.254485+0000","last_peered":"2024-03-23T23:56:32.254485+0000","last_clean":"2024-03-23T23:56:32.254485+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:56:32.254485+0000","last_undegraded":"2024-03-23T23:56:32.254485+0000","last_fullsized":"2024-03-23T23:56:32.254485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257949+0000","last_change":"2024-03-23T23:56:30.885446+0000","last_active":"2024-03-23T23:56:32.257949+0000","last_peered":"2024-03-23T23:56:32.257949+0000","last_clean":"2024-03-23T23:56:32.257949+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:56:32.257949+0000","last_undegraded":"2024-03-23T23:56:32.257949+0000","last_fullsized":"2024-03-23T23:56:32.257949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879747+0000","last_change":"2024-03-23T23:56:30.882609+0000","last_active":"2024-03-23T23:56:31.879747+0000","last_peered":"2024-03-23T23:56:31.879747+0000","last_clean":"2024-03-23T23:56:31.879747+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:56:31.879747+0000","last_undegraded":"2024-03-23T23:56:31.879747+0000","last_fullsized":"2024-03-23T23:56:31.879747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886361+0000","last_change":"2024-03-23T23:56:30.881031+0000","last_active":"2024-03-23T23:56:31.886361+0000","last_peered":"2024-03-23T23:56:31.886361+0000","last_clean":"2024-03-23T23:56:31.886361+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:56:31.886361+0000","last_undegraded":"2024-03-23T23:56:31.886361+0000","last_fullsized":"2024-03-23T23:56:31.886361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258083+0000","last_change":"2024-03-23T23:56:30.887942+0000","last_active":"2024-03-23T23:56:32.258083+0000","last_peered":"2024-03-23T23:56:32.258083+0000","last_clean":"2024-03-23T23:56:32.258083+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:56:32.258083+0000","last_undegraded":"2024-03-23T23:56:32.258083+0000","last_fullsized":"2024-03-23T23:56:32.258083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257607+0000","last_change":"2024-03-23T23:56:30.882527+0000","last_active":"2024-03-23T23:56:32.257607+0000","last_peered":"2024-03-23T23:56:32.257607+0000","last_clean":"2024-03-23T23:56:32.257607+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:56:32.257607+0000","last_undegraded":"2024-03-23T23:56:32.257607+0000","last_fullsized":"2024-03-23T23:56:32.257607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254651+0000","last_change":"2024-03-23T23:56:30.885451+0000","last_active":"2024-03-23T23:56:32.254651+0000","last_peered":"2024-03-23T23:56:32.254651+0000","last_clean":"2024-03-23T23:56:32.254651+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:56:32.254651+0000","last_undegraded":"2024-03-23T23:56:32.254651+0000","last_fullsized":"2024-03-23T23:56:32.254651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255346+0000","last_change":"2024-03-23T23:56:30.880152+0000","last_active":"2024-03-23T23:56:32.255346+0000","last_peered":"2024-03-23T23:56:32.255346+0000","last_clean":"2024-03-23T23:56:32.255346+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:56:32.255346+0000","last_undegraded":"2024-03-23T23:56:32.255346+0000","last_fullsized":"2024-03-23T23:56:32.255346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:17.288541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.878895+0000","last_change":"2024-03-23T23:56:30.880378+0000","last_active":"2024-03-23T23:56:31.878895+0000","last_peered":"2024-03-23T23:56:31.878895+0000","last_clean":"2024-03-23T23:56:31.878895+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:56:31.878895+0000","last_undegraded":"2024-03-23T23:56:31.878895+0000","last_fullsized":"2024-03-23T23:56:31.878895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879226+0000","last_change":"2024-03-23T23:56:30.869148+0000","last_active":"2024-03-23T23:56:31.879226+0000","last_peered":"2024-03-23T23:56:31.879226+0000","last_clean":"2024-03-23T23:56:31.879226+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:56:31.879226+0000","last_undegraded":"2024-03-23T23:56:31.879226+0000","last_fullsized":"2024-03-23T23:56:31.879226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:38.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257347+0000","last_change":"2024-03-23T23:56:29.890549+0000","last_active":"2024-03-23T23:56:32.257347+0000","last_peered":"2024-03-23T23:56:32.257347+0000","last_clean":"2024-03-23T23:56:32.257347+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:56:32.257347+0000","last_undegraded":"2024-03-23T23:56:32.257347+0000","last_fullsized":"2024-03-23T23:56:32.257347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257985+0000","last_change":"2024-03-23T23:56:30.885979+0000","last_active":"2024-03-23T23:56:32.257985+0000","last_peered":"2024-03-23T23:56:32.257985+0000","last_clean":"2024-03-23T23:56:32.257985+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:56:32.257985+0000","last_undegraded":"2024-03-23T23:56:32.257985+0000","last_fullsized":"2024-03-23T23:56:32.257985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879119+0000","last_change":"2024-03-23T23:56:29.892444+0000","last_active":"2024-03-23T23:56:31.879119+0000","last_peered":"2024-03-23T23:56:31.879119+0000","last_clean":"2024-03-23T23:56:31.879119+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:56:31.879119+0000","last_undegraded":"2024-03-23T23:56:31.879119+0000","last_fullsized":"2024-03-23T23:56:31.879119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254322+0000","last_change":"2024-03-23T23:56:29.887065+0000","last_active":"2024-03-23T23:56:32.254322+0000","last_peered":"2024-03-23T23:56:32.254322+0000","last_clean":"2024-03-23T23:56:32.254322+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:56:32.254322+0000","last_undegraded":"2024-03-23T23:56:32.254322+0000","last_fullsized":"2024-03-23T23:56:32.254322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:05:45.290286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253905+0000","last_change":"2024-03-23T23:56:30.881409+0000","last_active":"2024-03-23T23:56:32.253905+0000","last_peered":"2024-03-23T23:56:32.253905+0000","last_clean":"2024-03-23T23:56:32.253905+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:56:32.253905+0000","last_undegraded":"2024-03-23T23:56:32.253905+0000","last_fullsized":"2024-03-23T23:56:32.253905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254835+0000","last_change":"2024-03-23T23:56:29.897340+0000","last_active":"2024-03-23T23:56:32.254835+0000","last_peered":"2024-03-23T23:56:32.254835+0000","last_clean":"2024-03-23T23:56:32.254835+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:56:32.254835+0000","last_undegraded":"2024-03-23T23:56:32.254835+0000","last_fullsized":"2024-03-23T23:56:32.254835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885515+0000","last_change":"2024-03-23T23:56:30.876574+0000","last_active":"2024-03-23T23:56:31.885515+0000","last_peered":"2024-03-23T23:56:31.885515+0000","last_clean":"2024-03-23T23:56:31.885515+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:56:31.885515+0000","last_undegraded":"2024-03-23T23:56:31.885515+0000","last_fullsized":"2024-03-23T23:56:31.885515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880683+0000","last_change":"2024-03-23T23:56:29.894494+0000","last_active":"2024-03-23T23:56:31.880683+0000","last_peered":"2024-03-23T23:56:31.880683+0000","last_clean":"2024-03-23T23:56:31.880683+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:56:31.880683+0000","last_undegraded":"2024-03-23T23:56:31.880683+0000","last_fullsized":"2024-03-23T23:56:31.880683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255328+0000","last_change":"2024-03-23T23:56:30.891335+0000","last_active":"2024-03-23T23:56:32.255328+0000","last_peered":"2024-03-23T23:56:32.255328+0000","last_clean":"2024-03-23T23:56:32.255328+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:56:32.255328+0000","last_undegraded":"2024-03-23T23:56:32.255328+0000","last_fullsized":"2024-03-23T23:56:32.255328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255238+0000","last_change":"2024-03-23T23:56:29.886369+0000","last_active":"2024-03-23T23:56:32.255238+0000","last_peered":"2024-03-23T23:56:32.255238+0000","last_clean":"2024-03-23T23:56:32.255238+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:56:32.255238+0000","last_undegraded":"2024-03-23T23:56:32.255238+0000","last_fullsized":"2024-03-23T23:56:32.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257122+0000","last_change":"2024-03-23T23:56:30.876882+0000","last_active":"2024-03-23T23:56:32.257122+0000","last_peered":"2024-03-23T23:56:32.257122+0000","last_clean":"2024-03-23T23:56:32.257122+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:56:32.257122+0000","last_undegraded":"2024-03-23T23:56:32.257122+0000","last_fullsized":"2024-03-23T23:56:32.257122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886446+0000","last_change":"2024-03-23T23:56:29.886611+0000","last_active":"2024-03-23T23:56:31.886446+0000","last_peered":"2024-03-23T23:56:31.886446+0000","last_clean":"2024-03-23T23:56:31.886446+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:56:31.886446+0000","last_undegraded":"2024-03-23T23:56:31.886446+0000","last_fullsized":"2024-03-23T23:56:31.886446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879896+0000","last_change":"2024-03-23T23:56:30.871258+0000","last_active":"2024-03-23T23:56:31.879896+0000","last_peered":"2024-03-23T23:56:31.879896+0000","last_clean":"2024-03-23T23:56:31.879896+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:56:31.879896+0000","last_undegraded":"2024-03-23T23:56:31.879896+0000","last_fullsized":"2024-03-23T23:56:31.879896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:12.879233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879697+0000","last_change":"2024-03-23T23:56:29.886316+0000","last_active":"2024-03-23T23:56:31.879697+0000","last_peered":"2024-03-23T23:56:31.879697+0000","last_clean":"2024-03-23T23:56:31.879697+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:56:31.879697+0000","last_undegraded":"2024-03-23T23:56:31.879697+0000","last_fullsized":"2024-03-23T23:56:31.879697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880255+0000","last_change":"2024-03-23T23:56:30.885592+0000","last_active":"2024-03-23T23:56:31.880255+0000","last_peered":"2024-03-23T23:56:31.880255+0000","last_clean":"2024-03-23T23:56:31.880255+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:56:31.880255+0000","last_undegraded":"2024-03-23T23:56:31.880255+0000","last_fullsized":"2024-03-23T23:56:31.880255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258275+0000","last_change":"2024-03-23T23:56:29.891265+0000","last_active":"2024-03-23T23:56:32.258275+0000","last_peered":"2024-03-23T23:56:32.258275+0000","last_clean":"2024-03-23T23:56:32.258275+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:56:32.258275+0000","last_undegraded":"2024-03-23T23:56:32.258275+0000","last_fullsized":"2024-03-23T23:56:32.258275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:53.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258434+0000","last_change":"2024-03-23T23:56:30.886240+0000","last_active":"2024-03-23T23:56:32.258434+0000","last_peered":"2024-03-23T23:56:32.258434+0000","last_clean":"2024-03-23T23:56:32.258434+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:56:32.258434+0000","last_undegraded":"2024-03-23T23:56:32.258434+0000","last_fullsized":"2024-03-23T23:56:32.258434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254833+0000","last_change":"2024-03-23T23:56:29.890485+0000","last_active":"2024-03-23T23:56:32.254833+0000","last_peered":"2024-03-23T23:56:32.254833+0000","last_clean":"2024-03-23T23:56:32.254833+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:56:32.254833+0000","last_undegraded":"2024-03-23T23:56:32.254833+0000","last_fullsized":"2024-03-23T23:56:32.254833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880483+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:56:31.880483+0000","last_peered":"2024-03-23T23:56:31.880483+0000","last_clean":"2024-03-23T23:56:31.880483+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:56:31.880483+0000","last_undegraded":"2024-03-23T23:56:31.880483+0000","last_fullsized":"2024-03-23T23:56:31.880483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879506+0000","last_change":"2024-03-23T23:56:29.896833+0000","last_active":"2024-03-23T23:56:31.879506+0000","last_peered":"2024-03-23T23:56:31.879506+0000","last_clean":"2024-03-23T23:56:31.879506+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:56:31.879506+0000","last_undegraded":"2024-03-23T23:56:31.879506+0000","last_fullsized":"2024-03-23T23:56:31.879506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879148+0000","last_change":"2024-03-23T23:56:30.876178+0000","last_active":"2024-03-23T23:56:31.879148+0000","last_peered":"2024-03-23T23:56:31.879148+0000","last_clean":"2024-03-23T23:56:31.879148+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:56:31.879148+0000","last_undegraded":"2024-03-23T23:56:31.879148+0000","last_fullsized":"2024-03-23T23:56:31.879148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255878+0000","last_change":"2024-03-23T23:56:29.879437+0000","last_active":"2024-03-23T23:56:32.255878+0000","last_peered":"2024-03-23T23:56:32.255878+0000","last_clean":"2024-03-23T23:56:32.255878+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:56:32.255878+0000","last_undegraded":"2024-03-23T23:56:32.255878+0000","last_fullsized":"2024-03-23T23:56:32.255878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880229+0000","last_change":"2024-03-23T23:56:30.888310+0000","last_active":"2024-03-23T23:56:31.880229+0000","last_peered":"2024-03-23T23:56:31.880229+0000","last_clean":"2024-03-23T23:56:31.880229+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:56:31.880229+0000","last_undegraded":"2024-03-23T23:56:31.880229+0000","last_fullsized":"2024-03-23T23:56:31.880229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881660+0000","last_change":"2024-03-23T23:56:29.892548+0000","last_active":"2024-03-23T23:56:31.881660+0000","last_peered":"2024-03-23T23:56:31.881660+0000","last_clean":"2024-03-23T23:56:31.881660+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:56:31.881660+0000","last_undegraded":"2024-03-23T23:56:31.881660+0000","last_fullsized":"2024-03-23T23:56:31.881660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:53:30.285127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880515+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:56:31.880515+0000","last_peered":"2024-03-23T23:56:31.880515+0000","last_clean":"2024-03-23T23:56:31.880515+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:56:31.880515+0000","last_undegraded":"2024-03-23T23:56:31.880515+0000","last_fullsized":"2024-03-23T23:56:31.880515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255780+0000","last_change":"2024-03-23T23:56:29.883486+0000","last_active":"2024-03-23T23:56:32.255780+0000","last_peered":"2024-03-23T23:56:32.255780+0000","last_clean":"2024-03-23T23:56:32.255780+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:56:32.255780+0000","last_undegraded":"2024-03-23T23:56:32.255780+0000","last_fullsized":"2024-03-23T23:56:32.255780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881016+0000","last_change":"2024-03-23T23:56:30.887560+0000","last_active":"2024-03-23T23:56:31.881016+0000","last_peered":"2024-03-23T23:56:31.881016+0000","last_clean":"2024-03-23T23:56:31.881016+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:56:31.881016+0000","last_undegraded":"2024-03-23T23:56:31.881016+0000","last_fullsized":"2024-03-23T23:56:31.881016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886628+0000","last_change":"2024-03-23T23:56:29.897890+0000","last_active":"2024-03-23T23:56:31.886628+0000","last_peered":"2024-03-23T23:56:31.886628+0000","last_clean":"2024-03-23T23:56:31.886628+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:56:31.886628+0000","last_undegraded":"2024-03-23T23:56:31.886628+0000","last_fullsized":"2024-03-23T23:56:31.886628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255074+0000","last_change":"2024-03-23T23:56:30.888006+0000","last_active":"2024-03-23T23:56:32.255074+0000","last_peered":"2024-03-23T23:56:32.255074+0000","last_clean":"2024-03-23T23:56:32.255074+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:56:32.255074+0000","last_undegraded":"2024-03-23T23:56:32.255074+0000","last_fullsized":"2024-03-23T23:56:32.255074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254929+0000","last_change":"2024-03-23T23:56:29.888464+0000","last_active":"2024-03-23T23:56:32.254929+0000","last_peered":"2024-03-23T23:56:32.254929+0000","last_clean":"2024-03-23T23:56:32.254929+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:56:32.254929+0000","last_undegraded":"2024-03-23T23:56:32.254929+0000","last_fullsized":"2024-03-23T23:56:32.254929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881147+0000","last_change":"2024-03-23T23:56:30.883536+0000","last_active":"2024-03-23T23:56:31.881147+0000","last_peered":"2024-03-23T23:56:31.881147+0000","last_clean":"2024-03-23T23:56:31.881147+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:56:31.881147+0000","last_undegraded":"2024-03-23T23:56:31.881147+0000","last_fullsized":"2024-03-23T23:56:31.881147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:30:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880683+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:56:31.880683+0000","last_peered":"2024-03-23T23:56:31.880683+0000","last_clean":"2024-03-23T23:56:31.880683+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:56:31.880683+0000","last_undegraded":"2024-03-23T23:56:31.880683+0000","last_fullsized":"2024-03-23T23:56:31.880683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254542+0000","last_change":"2024-03-23T23:56:29.886033+0000","last_active":"2024-03-23T23:56:32.254542+0000","last_peered":"2024-03-23T23:56:32.254542+0000","last_clean":"2024-03-23T23:56:32.254542+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:56:32.254542+0000","last_undegraded":"2024-03-23T23:56:32.254542+0000","last_fullsized":"2024-03-23T23:56:32.254542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254736+0000","last_change":"2024-03-23T23:56:30.883752+0000","last_active":"2024-03-23T23:56:32.254736+0000","last_peered":"2024-03-23T23:56:32.254736+0000","last_clean":"2024-03-23T23:56:32.254736+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:56:32.254736+0000","last_undegraded":"2024-03-23T23:56:32.254736+0000","last_fullsized":"2024-03-23T23:56:32.254736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879967+0000","last_change":"2024-03-23T23:56:29.881565+0000","last_active":"2024-03-23T23:56:31.879967+0000","last_peered":"2024-03-23T23:56:31.879967+0000","last_clean":"2024-03-23T23:56:31.879967+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:56:31.879967+0000","last_undegraded":"2024-03-23T23:56:31.879967+0000","last_fullsized":"2024-03-23T23:56:31.879967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256063+0000","last_change":"2024-03-23T23:56:30.886503+0000","last_active":"2024-03-23T23:56:32.256063+0000","last_peered":"2024-03-23T23:56:32.256063+0000","last_clean":"2024-03-23T23:56:32.256063+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:56:32.256063+0000","last_undegraded":"2024-03-23T23:56:32.256063+0000","last_fullsized":"2024-03-23T23:56:32.256063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:02:03.136599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254842+0000","last_change":"2024-03-23T23:56:29.886668+0000","last_active":"2024-03-23T23:56:32.254842+0000","last_peered":"2024-03-23T23:56:32.254842+0000","last_clean":"2024-03-23T23:56:32.254842+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:56:32.254842+0000","last_undegraded":"2024-03-23T23:56:32.254842+0000","last_fullsized":"2024-03-23T23:56:32.254842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885797+0000","last_change":"2024-03-23T23:56:30.873826+0000","last_active":"2024-03-23T23:56:31.885797+0000","last_peered":"2024-03-23T23:56:31.885797+0000","last_clean":"2024-03-23T23:56:31.885797+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:56:31.885797+0000","last_undegraded":"2024-03-23T23:56:31.885797+0000","last_fullsized":"2024-03-23T23:56:31.885797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254909+0000","last_change":"2024-03-23T23:56:29.889635+0000","last_active":"2024-03-23T23:56:32.254909+0000","last_peered":"2024-03-23T23:56:32.254909+0000","last_clean":"2024-03-23T23:56:32.254909+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:56:32.254909+0000","last_undegraded":"2024-03-23T23:56:32.254909+0000","last_fullsized":"2024-03-23T23:56:32.254909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879010+0000","last_change":"2024-03-23T23:56:30.883369+0000","last_active":"2024-03-23T23:56:31.879010+0000","last_peered":"2024-03-23T23:56:31.879010+0000","last_clean":"2024-03-23T23:56:31.879010+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:56:31.879010+0000","last_undegraded":"2024-03-23T23:56:31.879010+0000","last_fullsized":"2024-03-23T23:56:31.879010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:12.049887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886128+0000","last_change":"2024-03-23T23:56:29.883626+0000","last_active":"2024-03-23T23:56:31.886128+0000","last_peered":"2024-03-23T23:56:31.886128+0000","last_clean":"2024-03-23T23:56:31.886128+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:56:31.886128+0000","last_undegraded":"2024-03-23T23:56:31.886128+0000","last_fullsized":"2024-03-23T23:56:31.886128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255652+0000","last_change":"2024-03-23T23:56:30.888942+0000","last_active":"2024-03-23T23:56:32.255652+0000","last_peered":"2024-03-23T23:56:32.255652+0000","last_clean":"2024-03-23T23:56:32.255652+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:56:32.255652+0000","last_undegraded":"2024-03-23T23:56:32.255652+0000","last_fullsized":"2024-03-23T23:56:32.255652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881316+0000","last_change":"2024-03-23T23:56:29.886058+0000","last_active":"2024-03-23T23:56:31.881316+0000","last_peered":"2024-03-23T23:56:31.881316+0000","last_clean":"2024-03-23T23:56:31.881316+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:56:31.881316+0000","last_undegraded":"2024-03-23T23:56:31.881316+0000","last_fullsized":"2024-03-23T23:56:31.881316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:16.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886086+0000","last_change":"2024-03-23T23:56:30.878188+0000","last_active":"2024-03-23T23:56:31.886086+0000","last_peered":"2024-03-23T23:56:31.886086+0000","last_clean":"2024-03-23T23:56:31.886086+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:56:31.886086+0000","last_undegraded":"2024-03-23T23:56:31.886086+0000","last_fullsized":"2024-03-23T23:56:31.886086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.889539+0000","last_change":"2024-03-23T23:56:29.884993+0000","last_active":"2024-03-23T23:56:31.889539+0000","last_peered":"2024-03-23T23:56:31.889539+0000","last_clean":"2024-03-23T23:56:31.889539+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:56:31.889539+0000","last_undegraded":"2024-03-23T23:56:31.889539+0000","last_fullsized":"2024-03-23T23:56:31.889539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258201+0000","last_change":"2024-03-23T23:56:30.896247+0000","last_active":"2024-03-23T23:56:32.258201+0000","last_peered":"2024-03-23T23:56:32.258201+0000","last_clean":"2024-03-23T23:56:32.258201+0000","last_became_active":"2024-03-23T23:56:30.895708+0000","last_became_peered":"2024-03-23T23:56:30.895708+0000","last_unstale":"2024-03-23T23:56:32.258201+0000","last_undegraded":"2024-03-23T23:56:32.258201+0000","last_fullsized":"2024-03-23T23:56:32.258201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880799+0000","last_change":"2024-03-23T23:56:29.881331+0000","last_active":"2024-03-23T23:56:31.880799+0000","last_peered":"2024-03-23T23:56:31.880799+0000","last_clean":"2024-03-23T23:56:31.880799+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:56:31.880799+0000","last_undegraded":"2024-03-23T23:56:31.880799+0000","last_fullsized":"2024-03-23T23:56:31.880799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257247+0000","last_change":"2024-03-23T23:56:30.874453+0000","last_active":"2024-03-23T23:56:32.257247+0000","last_peered":"2024-03-23T23:56:32.257247+0000","last_clean":"2024-03-23T23:56:32.257247+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:56:32.257247+0000","last_undegraded":"2024-03-23T23:56:32.257247+0000","last_fullsized":"2024-03-23T23:56:32.257247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879945+0000","last_change":"2024-03-23T23:56:29.879862+0000","last_active":"2024-03-23T23:56:31.879945+0000","last_peered":"2024-03-23T23:56:31.879945+0000","last_clean":"2024-03-23T23:56:31.879945+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:56:31.879945+0000","last_undegraded":"2024-03-23T23:56:31.879945+0000","last_fullsized":"2024-03-23T23:56:31.879945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881495+0000","last_change":"2024-03-23T23:56:30.874693+0000","last_active":"2024-03-23T23:56:31.881495+0000","last_peered":"2024-03-23T23:56:31.881495+0000","last_clean":"2024-03-23T23:56:31.881495+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:56:31.881495+0000","last_undegraded":"2024-03-23T23:56:31.881495+0000","last_fullsized":"2024-03-23T23:56:31.881495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885663+0000","last_change":"2024-03-23T23:56:29.887900+0000","last_active":"2024-03-23T23:56:31.885663+0000","last_peered":"2024-03-23T23:56:31.885663+0000","last_clean":"2024-03-23T23:56:31.885663+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:56:31.885663+0000","last_undegraded":"2024-03-23T23:56:31.885663+0000","last_fullsized":"2024-03-23T23:56:31.885663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254162+0000","last_change":"2024-03-23T23:56:30.875932+0000","last_active":"2024-03-23T23:56:32.254162+0000","last_peered":"2024-03-23T23:56:32.254162+0000","last_clean":"2024-03-23T23:56:32.254162+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:56:32.254162+0000","last_undegraded":"2024-03-23T23:56:32.254162+0000","last_fullsized":"2024-03-23T23:56:32.254162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885953+0000","last_change":"2024-03-23T23:56:29.884727+0000","last_active":"2024-03-23T23:56:31.885953+0000","last_peered":"2024-03-23T23:56:31.885953+0000","last_clean":"2024-03-23T23:56:31.885953+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:56:31.885953+0000","last_undegraded":"2024-03-23T23:56:31.885953+0000","last_fullsized":"2024-03-23T23:56:31.885953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257237+0000","last_change":"2024-03-23T23:56:30.887213+0000","last_active":"2024-03-23T23:56:32.257237+0000","last_peered":"2024-03-23T23:56:32.257237+0000","last_clean":"2024-03-23T23:56:32.257237+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:56:32.257237+0000","last_undegraded":"2024-03-23T23:56:32.257237+0000","last_fullsized":"2024-03-23T23:56:32.257237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880607+0000","last_change":"2024-03-23T23:56:29.895498+0000","last_active":"2024-03-23T23:56:31.880607+0000","last_peered":"2024-03-23T23:56:31.880607+0000","last_clean":"2024-03-23T23:56:31.880607+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:56:31.880607+0000","last_undegraded":"2024-03-23T23:56:31.880607+0000","last_fullsized":"2024-03-23T23:56:31.880607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879020+0000","last_change":"2024-03-23T23:56:30.884001+0000","last_active":"2024-03-23T23:56:31.879020+0000","last_peered":"2024-03-23T23:56:31.879020+0000","last_clean":"2024-03-23T23:56:31.879020+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:56:31.879020+0000","last_undegraded":"2024-03-23T23:56:31.879020+0000","last_fullsized":"2024-03-23T23:56:31.879020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255206+0000","last_change":"2024-03-23T23:56:30.889155+0000","last_active":"2024-03-23T23:56:32.255206+0000","last_peered":"2024-03-23T23:56:32.255206+0000","last_clean":"2024-03-23T23:56:32.255206+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:56:32.255206+0000","last_undegraded":"2024-03-23T23:56:32.255206+0000","last_fullsized":"2024-03-23T23:56:32.255206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880243+0000","last_change":"2024-03-23T23:56:29.888617+0000","last_active":"2024-03-23T23:56:31.880243+0000","last_peered":"2024-03-23T23:56:31.880243+0000","last_clean":"2024-03-23T23:56:31.880243+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:56:31.880243+0000","last_undegraded":"2024-03-23T23:56:31.880243+0000","last_fullsized":"2024-03-23T23:56:31.880243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254874+0000","last_change":"2024-03-23T23:56:30.888308+0000","last_active":"2024-03-23T23:56:32.254874+0000","last_peered":"2024-03-23T23:56:32.254874+0000","last_clean":"2024-03-23T23:56:32.254874+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:56:32.254874+0000","last_undegraded":"2024-03-23T23:56:32.254874+0000","last_fullsized":"2024-03-23T23:56:32.254874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881151+0000","last_change":"2024-03-23T23:56:29.879942+0000","last_active":"2024-03-23T23:56:31.881151+0000","last_peered":"2024-03-23T23:56:31.881151+0000","last_clean":"2024-03-23T23:56:31.881151+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:56:31.881151+0000","last_undegraded":"2024-03-23T23:56:31.881151+0000","last_fullsized":"2024-03-23T23:56:31.881151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256890+0000","last_change":"2024-03-23T23:56:30.880556+0000","last_active":"2024-03-23T23:56:32.256890+0000","last_peered":"2024-03-23T23:56:32.256890+0000","last_clean":"2024-03-23T23:56:32.256890+0000","last_became_active":"2024-03-23T23:56:30.880059+0000","last_became_peered":"2024-03-23T23:56:30.880059+0000","last_unstale":"2024-03-23T23:56:32.256890+0000","last_undegraded":"2024-03-23T23:56:32.256890+0000","last_fullsized":"2024-03-23T23:56:32.256890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258932+0000","last_change":"2024-03-23T23:56:29.889380+0000","last_active":"2024-03-23T23:56:32.258932+0000","last_peered":"2024-03-23T23:56:32.258932+0000","last_clean":"2024-03-23T23:56:32.258932+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:56:32.258932+0000","last_undegraded":"2024-03-23T23:56:32.258932+0000","last_fullsized":"2024-03-23T23:56:32.258932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258708+0000","last_change":"2024-03-23T23:56:30.885383+0000","last_active":"2024-03-23T23:56:32.258708+0000","last_peered":"2024-03-23T23:56:32.258708+0000","last_clean":"2024-03-23T23:56:32.258708+0000","last_became_active":"2024-03-23T23:56:30.885039+0000","last_became_peered":"2024-03-23T23:56:30.885039+0000","last_unstale":"2024-03-23T23:56:32.258708+0000","last_undegraded":"2024-03-23T23:56:32.258708+0000","last_fullsized":"2024-03-23T23:56:32.258708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257029+0000","last_change":"2024-03-23T23:56:29.886266+0000","last_active":"2024-03-23T23:56:32.257029+0000","last_peered":"2024-03-23T23:56:32.257029+0000","last_clean":"2024-03-23T23:56:32.257029+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:56:32.257029+0000","last_undegraded":"2024-03-23T23:56:32.257029+0000","last_fullsized":"2024-03-23T23:56:32.257029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:56:35.888 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-23T23:56:35.889 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-23T23:56:35.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-23T23:56:35.889 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-23T23:56:35.889 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-23T23:56:36.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.150+0000 7f9a9cc00640 1 Processor -- start 2024-03-23T23:56:36.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.150+0000 7f9a9cc00640 1 -- start start 2024-03-23T23:56:36.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.151+0000 7f9a9cc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a980723a0 0x7f9a9806c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.151+0000 7f9a9cc00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806cdb0 0x7f9a98147c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.151+0000 7f9a9cc00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9806df80 con 0x7f9a9806dba0 2024-03-23T23:56:36.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.151+0000 7f9a9cc00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a98148170 con 0x7f9a980723a0 2024-03-23T23:56:36.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.151+0000 7f9a9cc00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98147170 con 0x7f9a9806cdb0 2024-03-23T23:56:36.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a8fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a980723a0 0x7f9a9806c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a95e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9a9806dba0 0x7f9a98072f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59394/0 (socket says 172.21.15.31:59394) 2024-03-23T23:56:36.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a95e00640 1 -- 172.21.15.31:0/268056593 learned_addr learned my addr 172.21.15.31:0/268056593 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:36.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a96800640 1 --2- 172.21.15.31:0/268056593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806cdb0 0x7f9a98147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a8fe00640 1 -- 172.21.15.31:0/268056593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806cdb0 msgr2=0x7f9a98147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:36.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a8fe00640 1 --2- 172.21.15.31:0/268056593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806cdb0 0x7f9a98147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a8fe00640 1 -- 172.21.15.31:0/268056593 >> v1:172.21.15.31:6789/0 conn(0x7f9a9806dba0 legacy=0x7f9a98072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.152+0000 7f9a8fe00640 1 -- 172.21.15.31:0/268056593 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98147430 con 0x7f9a980723a0 2024-03-23T23:56:36.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.153+0000 7f9a8fe00640 1 --2- 172.21.15.31:0/268056593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a980723a0 0x7f9a9806c1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a800097a0 tx=0x7f9a8002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d10ee4250d1a8a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:36.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a95400640 1 -- 172.21.15.31:0/268056593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80035020 con 0x7f9a980723a0 2024-03-23T23:56:36.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a95400640 1 -- 172.21.15.31:0/268056593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a80031810 con 0x7f9a980723a0 2024-03-23T23:56:36.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a95400640 1 -- 172.21.15.31:0/268056593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80031be0 con 0x7f9a980723a0 2024-03-23T23:56:36.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 -- 172.21.15.31:0/268056593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a980723a0 msgr2=0x7f9a9806c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/268056593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a980723a0 0x7f9a9806c1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9a800097a0 tx=0x7f9a8002b8b0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 -- 172.21.15.31:0/268056593 shutdown_connections 2024-03-23T23:56:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/268056593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806cdb0 0x7f9a98147c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/268056593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a980723a0 0x7f9a9806c1a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 -- 172.21.15.31:0/268056593 >> 172.21.15.31:0/268056593 conn(0x7f9a98067650 msgr2=0x7f9a980baa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 -- 172.21.15.31:0/268056593 shutdown_connections 2024-03-23T23:56:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.154+0000 7f9a9cc00640 1 -- 172.21.15.31:0/268056593 wait complete. 2024-03-23T23:56:36.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.156+0000 7f9a9cc00640 1 Processor -- start 2024-03-23T23:56:36.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.156+0000 7f9a9cc00640 1 -- start start 2024-03-23T23:56:36.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a9cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a9806cdb0 0x7f9a9813b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a9cc00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806dba0 0x7f9a981e0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a9cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a980723a0 0x7f9a98143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a9cc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98151af0 con 0x7f9a9806cdb0 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a9cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98073660 con 0x7f9a980723a0 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a9cc00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98151c70 con 0x7f9a9806dba0 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a95e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a9806cdb0 0x7f9a9813b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a95e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a9806cdb0 0x7f9a9813b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60900/0 (socket says 172.21.15.31:60900) 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a95e00640 1 -- 172.21.15.31:0/418879249 learned_addr learned my addr 172.21.15.31:0/418879249 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:36.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.157+0000 7f9a8fe00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806dba0 0x7f9a981e0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a95e00640 1 -- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806dba0 msgr2=0x7f9a981e0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a95e00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806dba0 0x7f9a981e0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a95e00640 1 -- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a980723a0 msgr2=0x7f9a98143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a95e00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a980723a0 0x7f9a98143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a95e00640 1 -- 172.21.15.31:0/418879249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98144af0 con 0x7f9a9806cdb0 2024-03-23T23:56:36.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a8fe00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806dba0 0x7f9a981e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:36.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a95e00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a9806cdb0 0x7f9a9813b430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800c400 tx=0x7f9a8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a8e000640 1 -- 172.21.15.31:0/418879249 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88017070 con 0x7f9a9806cdb0 2024-03-23T23:56:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a8e000640 1 -- 172.21.15.31:0/418879249 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a88005ce0 con 0x7f9a9806cdb0 2024-03-23T23:56:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a8e000640 1 -- 172.21.15.31:0/418879249 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a880072f0 con 0x7f9a9806cdb0 2024-03-23T23:56:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9813f170 con 0x7f9a9806cdb0 2024-03-23T23:56:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.158+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9813ee90 con 0x7f9a9806cdb0 2024-03-23T23:56:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.159+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a980b5160 con 0x7f9a9806cdb0 2024-03-23T23:56:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.161+0000 7f9a8e000640 1 -- 172.21.15.31:0/418879249 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9a8801a070 con 0x7f9a9806cdb0 2024-03-23T23:56:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.161+0000 7f9a8e000640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9a7406bbd0 0x7f9a7406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.162+0000 7f9a8e000640 1 -- 172.21.15.31:0/418879249 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a88089e60 con 0x7f9a9806cdb0 2024-03-23T23:56:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.162+0000 7f9a8fe00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9a7406bbd0 0x7f9a7406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.163+0000 7f9a8fe00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9a7406bbd0 0x7f9a7406e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a80036000 tx=0x7f9a80008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.166+0000 7f9a8e000640 1 -- 172.21.15.31:0/418879249 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9a980b5160 con 0x7f9a9806cdb0 2024-03-23T23:56:36.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.420+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9a9804f400 con 0x7f9a9806cdb0 2024-03-23T23:56:36.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.424+0000 7f9a8e000640 1 -- 172.21.15.31:0/418879249 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+172576 (secure 0 0 0) 0x7f9a88058940 con 0x7f9a9806cdb0 2024-03-23T23:56:36.427 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.428+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9a7406bbd0 msgr2=0x7f9a7406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.428+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9a7406bbd0 0x7f9a7406e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a80036000 tx=0x7f9a80008030 comp rx=0 tx=0).stop 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.428+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a9806cdb0 msgr2=0x7f9a9813b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.428+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a9806cdb0 0x7f9a9813b430 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800c400 tx=0x7f9a8800c8c0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 shutdown_connections 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9a7406bbd0 0x7f9a7406e090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a980723a0 0x7f9a98143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a9806dba0 0x7f9a981e0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 --2- 172.21.15.31:0/418879249 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a9806cdb0 0x7f9a9813b430 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 >> 172.21.15.31:0/418879249 conn(0x7f9a98067650 msgr2=0x7f9a9813c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 shutdown_connections 2024-03-23T23:56:36.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.429+0000 7f9a9cc00640 1 -- 172.21.15.31:0/418879249 wait complete. 2024-03-23T23:56:36.446 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":794111806},{"type":"v1","addr":"172.21.15.59:6833","nonce":794111806}]},"active_addr":"172.21.15.59:6833/794111806","active_change":"2024-03-23T23:56:09.291969+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3677900221}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3662959587}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2350823797}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3174145598}]}]} 2024-03-23T23:56:36.450 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-23T23:56:36.450 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-23T23:56:36.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:36.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.658+0000 7fc780a00640 1 Processor -- start 2024-03-23T23:56:36.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.658+0000 7fc780a00640 1 -- start start 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.659+0000 7fc780a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc77c0b3440 0x7fc77c0b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.659+0000 7fc780a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc77c142180 0x7fc77c1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.659+0000 7fc780a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c09c920 con 0x7fc77c148850 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.659+0000 7fc780a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c0b2fb0 con 0x7fc77c142180 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.659+0000 7fc780a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c0b3dc0 con 0x7fc77c0b3440 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc77b200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc77c142180 0x7fc77c1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc77b200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc77c142180 0x7fc77c1425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60904/0 (socket says 172.21.15.31:60904) 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc77b200640 1 -- 172.21.15.31:0/1515221326 learned_addr learned my addr 172.21.15.31:0/1515221326 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:36.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc779e00640 1 --2- 172.21.15.31:0/1515221326 >> v2:172.21.15.59:3300/0 conn(0x7fc77c0b3440 0x7fc77c0b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc77b200640 1 -- 172.21.15.31:0/1515221326 >> v2:172.21.15.59:3300/0 conn(0x7fc77c0b3440 msgr2=0x7fc77c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:36.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc77b200640 1 --2- 172.21.15.31:0/1515221326 >> v2:172.21.15.59:3300/0 conn(0x7fc77c0b3440 0x7fc77c0b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc77b200640 1 -- 172.21.15.31:0/1515221326 >> v1:172.21.15.59:6789/0 conn(0x7fc77c148850 legacy=0x7fc77c09b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:36.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.660+0000 7fc77b200640 1 -- 172.21.15.31:0/1515221326 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c142b10 con 0x7fc77c142180 2024-03-23T23:56:36.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.661+0000 7fc77b200640 1 --2- 172.21.15.31:0/1515221326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c142180 0x7fc77c1425d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0b3130 tx=0x7fc77402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2cf26b450d91ba server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:36.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc779400640 1 -- 172.21.15.31:0/1515221326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77402ca70 con 0x7fc77c142180 2024-03-23T23:56:36.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc779400640 1 -- 172.21.15.31:0/1515221326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77402cc10 con 0x7fc77c142180 2024-03-23T23:56:36.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc779400640 1 -- 172.21.15.31:0/1515221326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7740343f0 con 0x7fc77c142180 2024-03-23T23:56:36.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc780a00640 1 -- 172.21.15.31:0/1515221326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c142180 msgr2=0x7fc77c1425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc780a00640 1 --2- 172.21.15.31:0/1515221326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c142180 0x7fc77c1425d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0b3130 tx=0x7fc77402bed0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc780a00640 1 -- 172.21.15.31:0/1515221326 shutdown_connections 2024-03-23T23:56:36.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc780a00640 1 --2- 172.21.15.31:0/1515221326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c142180 0x7fc77c1425d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc780a00640 1 --2- 172.21.15.31:0/1515221326 >> v2:172.21.15.59:3300/0 conn(0x7fc77c0b3440 0x7fc77c0b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc780a00640 1 -- 172.21.15.31:0/1515221326 >> 172.21.15.31:0/1515221326 conn(0x7fc77c0b85b0 msgr2=0x7fc77c0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:36.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.662+0000 7fc780a00640 1 -- 172.21.15.31:0/1515221326 shutdown_connections 2024-03-23T23:56:36.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.663+0000 7fc780a00640 1 -- 172.21.15.31:0/1515221326 wait complete. 2024-03-23T23:56:36.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.664+0000 7fc780a00640 1 Processor -- start 2024-03-23T23:56:36.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.664+0000 7fc780a00640 1 -- start start 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc780a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c0b3440 0x7fc77c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc780a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc77c142180 0x7fc77c144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc780a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc77c148850 0x7fc77c1405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc780a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0b93e0 con 0x7fc77c0b3440 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc780a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c149330 con 0x7fc77c148850 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc780a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c148c30 con 0x7fc77c142180 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc77a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c0b3440 0x7fc77c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc77a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c0b3440 0x7fc77c0afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60912/0 (socket says 172.21.15.31:60912) 2024-03-23T23:56:36.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc77a800640 1 -- 172.21.15.31:0/2277587321 learned_addr learned my addr 172.21.15.31:0/2277587321 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:36.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.665+0000 7fc77b200640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc77c148850 0x7fc77c1405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc779e00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc77c142180 0x7fc77c144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc77a800640 1 -- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc77c142180 msgr2=0x7fc77c144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc77a800640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc77c142180 0x7fc77c144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc77a800640 1 -- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc77c148850 msgr2=0x7fc77c1405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc77a800640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc77c148850 0x7fc77c1405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc77a800640 1 -- 172.21.15.31:0/2277587321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c13d310 con 0x7fc77c0b3440 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc77b200640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc77c148850 0x7fc77c1405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc779e00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc77c142180 0x7fc77c144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc77a800640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c0b3440 0x7fc77c0afa40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b3f0 tx=0x7fc76c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc772a00640 1 -- 172.21.15.31:0/2277587321 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c015020 con 0x7fc77c0b3440 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc772a00640 1 -- 172.21.15.31:0/2277587321 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c011830 con 0x7fc77c0b3440 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c140ff0 con 0x7fc77c0b3440 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc772a00640 1 -- 172.21.15.31:0/2277587321 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c011c20 con 0x7fc77c0b3440 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.666+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c0b2940 con 0x7fc77c0b3440 2024-03-23T23:56:36.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.667+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c0752c0 con 0x7fc77c0b3440 2024-03-23T23:56:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.668+0000 7fc772a00640 1 -- 172.21.15.31:0/2277587321 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc76c018020 con 0x7fc77c0b3440 2024-03-23T23:56:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.669+0000 7fc772a00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc75c06bbd0 0x7fc75c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:36.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.669+0000 7fc772a00640 1 -- 172.21.15.31:0/2277587321 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc76c08a600 con 0x7fc77c0b3440 2024-03-23T23:56:36.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.670+0000 7fc779e00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc75c06bbd0 0x7fc75c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:36.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.671+0000 7fc779e00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc75c06bbd0 0x7fc75c06e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc77c13e9b0 tx=0x7fc768008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:36.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.674+0000 7fc772a00640 1 -- 172.21.15.31:0/2277587321 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fc76c01f030 con 0x7fc77c0b3440 2024-03-23T23:56:36.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.875+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc77c0b5500 con 0x7fc77c0b3440 2024-03-23T23:56:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.877+0000 7fc772a00640 1 -- 172.21.15.31:0/2277587321 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16533 (secure 0 0 0) 0x7fc76c0172c0 con 0x7fc77c0b3440 2024-03-23T23:56:36.878 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:36.878 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:31.864837+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc75c06bbd0 msgr2=0x7fc75c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc75c06bbd0 0x7fc75c06e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc77c13e9b0 tx=0x7fc768008040 comp rx=0 tx=0).stop 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c0b3440 msgr2=0x7fc77c0afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c0b3440 0x7fc77c0afa40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b3f0 tx=0x7fc76c00b8b0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 shutdown_connections 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc75c06bbd0 0x7fc75c06e090 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc77c148850 0x7fc77c1405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc77c142180 0x7fc77c144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 --2- 172.21.15.31:0/2277587321 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc77c0b3440 0x7fc77c0afa40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.880+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 >> 172.21.15.31:0/2277587321 conn(0x7fc77c0b85b0 msgr2=0x7fc77c0b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.881+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 shutdown_connections 2024-03-23T23:56:36.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:36.881+0000 7fc780a00640 1 -- 172.21.15.31:0/2277587321 wait complete. 2024-03-23T23:56:36.899 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-23T23:56:36.899 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:37.117 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.117+0000 7f6642000640 1 Processor -- start 2024-03-23T23:56:37.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.118+0000 7f6642000640 1 -- start start 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6642000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f663c0b5210 0x7f663c14a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6642000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b6bc0 0x7f663c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6642000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0b3e60 con 0x7f663c0b9850 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6642000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f663c0b55f0 con 0x7f663c0b5210 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6642000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b9dc0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6640c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f663c0b5210 0x7f663c14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6640c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f663c0b5210 0x7f663c14a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60918/0 (socket says 172.21.15.31:60918) 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f663be00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f663c0b9850 0x7f663c0b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59404/0 (socket says 172.21.15.31:59404) 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.119+0000 7f6640c00640 1 -- 172.21.15.31:0/3578235523 learned_addr learned my addr 172.21.15.31:0/3578235523 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.120+0000 7f6641600640 1 --2- 172.21.15.31:0/3578235523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b6bc0 0x7f663c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.120+0000 7f6640c00640 1 -- 172.21.15.31:0/3578235523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b6bc0 msgr2=0x7f663c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.120+0000 7f6640c00640 1 --2- 172.21.15.31:0/3578235523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b6bc0 0x7f663c14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.120+0000 7f6640c00640 1 -- 172.21.15.31:0/3578235523 >> v1:172.21.15.31:6789/0 conn(0x7f663c0b9850 legacy=0x7f663c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.120+0000 7f6640c00640 1 -- 172.21.15.31:0/3578235523 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0b4100 con 0x7f663c0b5210 2024-03-23T23:56:37.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.120+0000 7f663b400640 1 -- 172.21.15.31:0/3578235523 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251626656 0 0) 0x7f663c0b3e60 con 0x7f663c0b9850 2024-03-23T23:56:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.121+0000 7f6640c00640 1 --2- 172.21.15.31:0/3578235523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b5210 0x7f663c14a850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6630009870 tx=0x7f663002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcac89a6d46c2f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.121+0000 7f663b400640 1 -- 172.21.15.31:0/3578235523 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630034070 con 0x7f663c0b5210 2024-03-23T23:56:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.121+0000 7f663b400640 1 -- 172.21.15.31:0/3578235523 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6630030840 con 0x7f663c0b5210 2024-03-23T23:56:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.121+0000 7f663b400640 1 -- 172.21.15.31:0/3578235523 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630030c10 con 0x7f663c0b5210 2024-03-23T23:56:37.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 -- 172.21.15.31:0/3578235523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b5210 msgr2=0x7f663c14a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 --2- 172.21.15.31:0/3578235523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b5210 0x7f663c14a850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6630009870 tx=0x7f663002b980 comp rx=0 tx=0).stop 2024-03-23T23:56:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 -- 172.21.15.31:0/3578235523 shutdown_connections 2024-03-23T23:56:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 --2- 172.21.15.31:0/3578235523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b6bc0 0x7f663c14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 --2- 172.21.15.31:0/3578235523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b5210 0x7f663c14a850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 -- 172.21.15.31:0/3578235523 >> 172.21.15.31:0/3578235523 conn(0x7f663c066fb0 msgr2=0x7f663c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 -- 172.21.15.31:0/3578235523 shutdown_connections 2024-03-23T23:56:37.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.122+0000 7f6642000640 1 -- 172.21.15.31:0/3578235523 wait complete. 2024-03-23T23:56:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.123+0000 7f6642000640 1 Processor -- start 2024-03-23T23:56:37.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.124+0000 7f6642000640 1 -- start start 2024-03-23T23:56:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.124+0000 7f6642000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c0b5210 0x7f663c142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.124+0000 7f6642000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b6bc0 0x7f663c1e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.124+0000 7f6642000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b9850 0x7f663c1df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.124+0000 7f6642000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b7c70 con 0x7f663c0b6bc0 2024-03-23T23:56:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.124+0000 7f6642000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b7af0 con 0x7f663c0b5210 2024-03-23T23:56:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.124+0000 7f6642000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b7df0 con 0x7f663c0b9850 2024-03-23T23:56:37.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b6bc0 0x7f663c1e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b6bc0 0x7f663c1e04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60924/0 (socket says 172.21.15.31:60924) 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 -- 172.21.15.31:0/384108305 learned_addr learned my addr 172.21.15.31:0/384108305 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f6640c00640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c0b5210 0x7f663c142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f6641600640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b9850 0x7f663c1df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 -- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b9850 msgr2=0x7f663c1df9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b9850 0x7f663c1df9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 -- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c0b5210 msgr2=0x7f663c142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c0b5210 0x7f663c142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.125+0000 7f663be00640 1 -- 172.21.15.31:0/384108305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c143ad0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.126+0000 7f663be00640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b6bc0 0x7f663c1e04f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f662800c420 tx=0x7f662800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.126+0000 7f6638c00640 1 -- 172.21.15.31:0/384108305 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66280074e0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.126+0000 7f6638c00640 1 -- 172.21.15.31:0/384108305 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66280047e0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.126+0000 7f6638c00640 1 -- 172.21.15.31:0/384108305 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628004c10 con 0x7f663c0b6bc0 2024-03-23T23:56:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.126+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c1440e0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.126+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c144bb0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.127+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c0752c0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.128+0000 7f6638c00640 1 -- 172.21.15.31:0/384108305 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6628011070 con 0x7f663c0b6bc0 2024-03-23T23:56:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.129+0000 7f6638c00640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f661c06bbd0 0x7f661c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.129+0000 7f6638c00640 1 -- 172.21.15.31:0/384108305 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f662808a6c0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.129+0000 7f6640c00640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f661c06bbd0 0x7f661c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.130+0000 7f6640c00640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f661c06bbd0 0x7f661c06e090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6630036000 tx=0x7f663003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.133+0000 7f6638c00640 1 -- 172.21.15.31:0/384108305 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f662800e280 con 0x7f663c0b6bc0 2024-03-23T23:56:37.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.336+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f663c0729f0 con 0x7f663c0b6bc0 2024-03-23T23:56:37.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.338+0000 7f6638c00640 1 -- 172.21.15.31:0/384108305 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f6628059110 con 0x7f663c0b6bc0 2024-03-23T23:56:37.338 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:37.338 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:31.864837+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.340+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f661c06bbd0 msgr2=0x7f661c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.340+0000 7f6642000640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f661c06bbd0 0x7f661c06e090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6630036000 tx=0x7f663003b040 comp rx=0 tx=0).stop 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.340+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b6bc0 msgr2=0x7f663c1e04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.340+0000 7f6642000640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b6bc0 0x7f663c1e04f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f662800c420 tx=0x7f662800c8e0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 shutdown_connections 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f661c06bbd0 0x7f661c06e090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f663c0b9850 0x7f663c1df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f663c0b6bc0 0x7f663c1e04f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 --2- 172.21.15.31:0/384108305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c0b5210 0x7f663c142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 >> 172.21.15.31:0/384108305 conn(0x7f663c066fb0 msgr2=0x7f663c0bd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 shutdown_connections 2024-03-23T23:56:37.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.341+0000 7f6642000640 1 -- 172.21.15.31:0/384108305 wait complete. 2024-03-23T23:56:37.360 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-23T23:56:37.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-23T23:56:37.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-23T23:56:37.361 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-23T23:56:37.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-23T23:56:37.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-23T23:56:37.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-23T23:56:37.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-23T23:56:37.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.667+0000 7f2adf000640 1 Processor -- start 2024-03-23T23:56:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.668+0000 7f2adf000640 1 -- start start 2024-03-23T23:56:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.669+0000 7f2adf000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0006ef0 0x7f2ad0036510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.669+0000 7f2adf000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad0029f60 con 0x7f2ad0033720 2024-03-23T23:56:37.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.670+0000 7f2adf000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00357e0 con 0x7f2ad0033b80 2024-03-23T23:56:37.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.670+0000 7f2adf000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0035590 con 0x7f2ad0006ef0 2024-03-23T23:56:37.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.670+0000 7f2add200640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2ad0033720 0x7f2ad00c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59416/0 (socket says 172.21.15.31:59416) 2024-03-23T23:56:37.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.670+0000 7f2add200640 1 -- 172.21.15.31:0/2074572312 learned_addr learned my addr 172.21.15.31:0/2074572312 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:37.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.670+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316110479 0 0) 0x7f2ad0029f60 con 0x7f2ad0033720 2024-03-23T23:56:37.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.671+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0003520 con 0x7f2ad0033720 2024-03-23T23:56:37.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.671+0000 7f2addc00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0006ef0 0x7f2ad0036510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.671+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 653588191 0 0) 0x7f2ac0003520 con 0x7f2ad0033720 2024-03-23T23:56:37.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.671+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0006ef0 msgr2=0x7f2ad0036510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.671+0000 7f2ad7e00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0006ef0 0x7f2ad0036510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.671+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 >> v1:172.21.15.59:6789/0 conn(0x7f2ad0033b80 legacy=0x7f2ad00d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.671+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0035ac0 con 0x7f2ad0033720 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f2ad804f920 con 0x7f2ad0033720 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 >> v1:172.21.15.31:6789/0 conn(0x7f2ad0033720 legacy=0x7f2ad00c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac0004800 0x7f2ac0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac0005210 0x7f2ac000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0035590 con 0x7f2ac0004800 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000c0a0 con 0x7f2ac00039e0 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000c2a0 con 0x7f2ac0005210 2024-03-23T23:56:37.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2addc00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0006ef0 0x7f2ad0036510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:37.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.672+0000 7f2addc00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.673+0000 7f2add200640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac0004800 0x7f2ac0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.673+0000 7f2addc00640 1 -- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac0005210 msgr2=0x7f2ac000b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T23:56:37.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.673+0000 7f2addc00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ac0005210 0x7f2ac000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.673+0000 7f2addc00640 1 -- 172.21.15.31:0/2074572312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac0004800 msgr2=0x7f2ac0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.673+0000 7f2addc00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ac0004800 0x7f2ac0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.673+0000 7f2addc00640 1 -- 172.21.15.31:0/2074572312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0003520 con 0x7f2ac00039e0 2024-03-23T23:56:37.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.675+0000 7f2addc00640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0007750 tx=0x7f2ac0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a58c78c5bc6ab097 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.676+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc03d070 con 0x7f2ac00039e0 2024-03-23T23:56:37.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.676+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc0307f0 con 0x7f2ac00039e0 2024-03-23T23:56:37.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.676+0000 7f2ad7e00640 1 -- 172.21.15.31:0/2074572312 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00a4d0 con 0x7f2ac00039e0 2024-03-23T23:56:37.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.676+0000 7ff301400640 1 Processor -- start 2024-03-23T23:56:37.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.677+0000 7f2adf000640 1 -- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 msgr2=0x7f2ac0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.677+0000 7f2adf000640 1 --2- 172.21.15.31:0/2074572312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 0x7f2ac0003e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0007750 tx=0x7f2ac0005830 comp rx=0 tx=0).stop 2024-03-23T23:56:37.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.677+0000 7f2ade600640 1 -- 172.21.15.31:0/2074572312 reap_dead start 2024-03-23T23:56:37.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.677+0000 7ff301400640 1 -- start start 2024-03-23T23:56:37.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7f4438e00640 1 Processor -- start 2024-03-23T23:56:37.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7f4438e00640 1 -- start start 2024-03-23T23:56:37.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7f2adf000640 1 -- 172.21.15.31:0/2074572312 shutdown_connections 2024-03-23T23:56:37.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7f2adf000640 1 -- 172.21.15.31:0/2074572312 >> 172.21.15.31:0/2074572312 conn(0x7f2ad003a8a0 msgr2=0x7f2ad003acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7ff301400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2fc0b9b10 0x7ff2fc1470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7ff301400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc147630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7ff301400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc0b9ef0 con 0x7ff2fc0b6ca0 2024-03-23T23:56:37.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7ff301400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b6530 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.678+0000 7ff301400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b4fb0 con 0x7ff2fc141460 2024-03-23T23:56:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.679+0000 7f2adf000640 1 -- 172.21.15.31:0/2074572312 shutdown_connections 2024-03-23T23:56:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.679+0000 7f2adf000640 1 -- 172.21.15.31:0/2074572312 wait complete. 2024-03-23T23:56:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.679+0000 7ff2fa800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2fc0b9b10 0x7ff2fc1470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.679+0000 7ff2fb200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.679+0000 7ff2fa800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2fc0b9b10 0x7ff2fc1470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45126/0 (socket says 172.21.15.31:45126) 2024-03-23T23:56:37.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.680+0000 7ff2fa800640 1 -- 172.21.15.31:0/723630107 learned_addr learned my addr 172.21.15.31:0/723630107 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.680+0000 7f4438e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f442c008da0 0x7f442c036750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.680+0000 7f4438e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c03a060 con 0x7f442c009180 2024-03-23T23:56:37.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.680+0000 7f4438e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c008050 con 0x7f442c008850 2024-03-23T23:56:37.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.680+0000 7f4438e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c0083c0 con 0x7f442c008da0 2024-03-23T23:56:37.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.681+0000 7f4432a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f442c009180 0x7f442c0cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59432/0 (socket says 172.21.15.31:59432) 2024-03-23T23:56:37.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.681+0000 7f4432a00640 1 -- 172.21.15.31:0/872561032 learned_addr learned my addr 172.21.15.31:0/872561032 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:37.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.681+0000 7f4433400640 1 --2- 172.21.15.31:0/872561032 >> v2:172.21.15.59:3300/0 conn(0x7f442c008da0 0x7f442c036750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.682+0000 7f2adf000640 1 Processor -- start 2024-03-23T23:56:37.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.682+0000 7f2adf000640 1 -- start start 2024-03-23T23:56:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.681+0000 7ff2fb200640 1 -- 172.21.15.31:0/723630107 >> v2:172.21.15.59:3300/0 conn(0x7ff2fc0b9b10 msgr2=0x7ff2fc1470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.681+0000 7ff2fb200640 1 --2- 172.21.15.31:0/723630107 >> v2:172.21.15.59:3300/0 conn(0x7ff2fc0b9b10 0x7ff2fc1470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.681+0000 7ff2fb200640 1 -- 172.21.15.31:0/723630107 >> v1:172.21.15.59:6789/0 conn(0x7ff2fc0b6ca0 legacy=0x7ff2fc140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.681+0000 7ff2fb200640 1 -- 172.21.15.31:0/723630107 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0b5290 con 0x7ff2fc141460 2024-03-23T23:56:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.683+0000 7f4432000640 1 -- 172.21.15.31:0/872561032 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576626451 0 0) 0x7f442c03a060 con 0x7f442c009180 2024-03-23T23:56:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.683+0000 7f4432000640 1 -- 172.21.15.31:0/872561032 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f441c003520 con 0x7f442c009180 2024-03-23T23:56:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.683+0000 7f4432000640 1 -- 172.21.15.31:0/872561032 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828400508 0 0) 0x7f442c008050 con 0x7f442c008850 2024-03-23T23:56:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.683+0000 7f4432000640 1 -- 172.21.15.31:0/872561032 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f442c03a060 con 0x7f442c008850 2024-03-23T23:56:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.683+0000 7f4433400640 1 -- 172.21.15.31:0/872561032 >> v1:172.21.15.59:6789/0 conn(0x7f442c008850 legacy=0x7f442c039950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.683+0000 7f4433400640 1 -- 172.21.15.31:0/872561032 >> v1:172.21.15.31:6789/0 conn(0x7f442c009180 legacy=0x7f442c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.683+0000 7f4433400640 1 -- 172.21.15.31:0/872561032 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c037010 con 0x7f442c008da0 2024-03-23T23:56:37.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.684+0000 7f2adf000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 0x7f2ad00c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.684+0000 7f2adf000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ad00c48b0 0x7f2ad01696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.684+0000 7f2adf000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0169c00 0x7f2ad00cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.684+0000 7f2adf000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00362c0 con 0x7f2ad00c48b0 2024-03-23T23:56:37.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.684+0000 7f2adf000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0035e30 con 0x7f2ac00039e0 2024-03-23T23:56:37.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.684+0000 7f2adf000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad0029c80 con 0x7f2ad0169c00 2024-03-23T23:56:37.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ad00c48b0 0x7f2ad01696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ad00c48b0 0x7f2ad01696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60952/0 (socket says 172.21.15.31:60952) 2024-03-23T23:56:37.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 -- 172.21.15.31:0/3585442524 learned_addr learned my addr 172.21.15.31:0/3585442524 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7ff2fb200640 1 --2- 172.21.15.31:0/723630107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc147630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009d90 tx=0x7ff2f402be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c88aebc70eebff9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7ff2f9400640 1 -- 172.21.15.31:0/723630107 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4039070 con 0x7ff2fc141460 2024-03-23T23:56:37.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7ff2f9400640 1 -- 172.21.15.31:0/723630107 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f402cc00 con 0x7ff2fc141460 2024-03-23T23:56:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2addc00640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 0x7f2ad00c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 -- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0169c00 msgr2=0x7f2ad00cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ad0169c00 0x7f2ad00cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 -- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 msgr2=0x7f2ad00c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ac00039e0 0x7f2ad00c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.685+0000 7f2add200640 1 -- 172.21.15.31:0/3585442524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00c5890 con 0x7f2ad00c48b0 2024-03-23T23:56:37.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f2add200640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ad00c48b0 0x7f2ad01696c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ad806a3a0 tx=0x7f2ad806a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f4433400640 1 --2- 172.21.15.31:0/872561032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 0x7f442c036750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44280097a0 tx=0x7f442802b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=683df7ced7ba005c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7ff2f9400640 1 -- 172.21.15.31:0/723630107 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4034440 con 0x7ff2fc141460 2024-03-23T23:56:37.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f0c75000640 1 Processor -- start 2024-03-23T23:56:37.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.687+0000 7f4432000640 1 -- 172.21.15.31:0/872561032 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428037070 con 0x7f442c008da0 2024-03-23T23:56:37.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.687+0000 7f4432000640 1 -- 172.21.15.31:0/872561032 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442802be50 con 0x7f442c008da0 2024-03-23T23:56:37.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.687+0000 7f4432000640 1 -- 172.21.15.31:0/872561032 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200015a0 con 0x7f442c008da0 2024-03-23T23:56:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.687+0000 7ff301400640 1 -- 172.21.15.31:0/723630107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 msgr2=0x7ff2fc147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.687+0000 7ff301400640 1 --2- 172.21.15.31:0/723630107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc147630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4009d90 tx=0x7ff2f402be50 comp rx=0 tx=0).stop 2024-03-23T23:56:37.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8096480 con 0x7f2ad00c48b0 2024-03-23T23:56:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8096620 con 0x7f2ad00c48b0 2024-03-23T23:56:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8096480 con 0x7f2ad00c48b0 2024-03-23T23:56:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad0033390 con 0x7f2ad00c48b0 2024-03-23T23:56:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.686+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad0032e70 con 0x7f2ad00c48b0 2024-03-23T23:56:37.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ad00c62c0 con 0x7f2ad00c48b0 2024-03-23T23:56:37.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.687+0000 7f0c75000640 1 -- start start 2024-03-23T23:56:37.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7ff301400640 1 -- 172.21.15.31:0/723630107 shutdown_connections 2024-03-23T23:56:37.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7ff301400640 1 --2- 172.21.15.31:0/723630107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc147630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7ff301400640 1 --2- 172.21.15.31:0/723630107 >> v2:172.21.15.59:3300/0 conn(0x7ff2fc0b9b10 0x7ff2fc1470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7ff301400640 1 -- 172.21.15.31:0/723630107 >> 172.21.15.31:0/723630107 conn(0x7ff2fc066fb0 msgr2=0x7ff2fc0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7f4438e00640 1 -- 172.21.15.31:0/872561032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 msgr2=0x7f442c036750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7f4438e00640 1 --2- 172.21.15.31:0/872561032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 0x7f442c036750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44280097a0 tx=0x7f442802b650 comp rx=0 tx=0).stop 2024-03-23T23:56:37.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7f4438e00640 1 -- 172.21.15.31:0/872561032 shutdown_connections 2024-03-23T23:56:37.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7f4438e00640 1 --2- 172.21.15.31:0/872561032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 0x7f442c036750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7f4438e00640 1 -- 172.21.15.31:0/872561032 >> 172.21.15.31:0/872561032 conn(0x7f442c03cab0 msgr2=0x7f442c03cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.688+0000 7f4438e00640 1 -- 172.21.15.31:0/872561032 shutdown_connections 2024-03-23T23:56:37.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7ff301400640 1 -- 172.21.15.31:0/723630107 shutdown_connections 2024-03-23T23:56:37.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7f4438e00640 1 -- 172.21.15.31:0/872561032 wait complete. 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7f0c75000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c700b4fa0 0x7f0c700b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7f0c75000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b3720 0x7f0c700b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7f0c75000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700b2100 con 0x7f0c700b5890 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7f0c75000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700b4b10 con 0x7f0c700b4fa0 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7f0c75000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700b2370 con 0x7f0c700b3720 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.690+0000 7f0c6e800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b3720 0x7f0c700b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.690+0000 7f0c6e800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b3720 0x7f0c700b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60840/0 (socket says 172.21.15.31:60840) 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.690+0000 7f0c6e800640 1 -- 172.21.15.31:0/4121420274 learned_addr learned my addr 172.21.15.31:0/4121420274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.690+0000 7f0c67e00640 1 --2- 172.21.15.31:0/4121420274 >> v2:172.21.15.59:3300/0 conn(0x7f0c700b4fa0 0x7f0c700b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.689+0000 7ff301400640 1 -- 172.21.15.31:0/723630107 wait complete. 2024-03-23T23:56:37.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.691+0000 7f0c6e800640 1 -- 172.21.15.31:0/4121420274 >> v2:172.21.15.59:3300/0 conn(0x7f0c700b4fa0 msgr2=0x7f0c700b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.691+0000 7f0c6e800640 1 --2- 172.21.15.31:0/4121420274 >> v2:172.21.15.59:3300/0 conn(0x7f0c700b4fa0 0x7f0c700b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.691+0000 7f4438e00640 1 Processor -- start 2024-03-23T23:56:37.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.691+0000 7f4438e00640 1 -- start start 2024-03-23T23:56:37.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.691+0000 7f0c6e800640 1 -- 172.21.15.31:0/4121420274 >> v1:172.21.15.59:6789/0 conn(0x7f0c700b5890 legacy=0x7f0c700b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.691+0000 7f0c6e800640 1 -- 172.21.15.31:0/4121420274 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700b5c70 con 0x7f0c700b3720 2024-03-23T23:56:37.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.692+0000 7ff1ae800640 1 Processor -- start 2024-03-23T23:56:37.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.692+0000 7ff301400640 1 Processor -- start 2024-03-23T23:56:37.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.691+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2ad80967f0 con 0x7f2ad00c48b0 2024-03-23T23:56:37.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.692+0000 7f2ad5600640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2ab806bdd0 0x7f2ab806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.693+0000 7f0c6e800640 1 --2- 172.21.15.31:0/4121420274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b3720 0x7f0c700b3bb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009e50 tx=0x7f0c6802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e67a3a132cbed1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.693+0000 7f2addc00640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2ab806bdd0 0x7f2ab806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.693+0000 7f4438e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c008850 0x7f442c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.693+0000 7f4438e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 0x7f442c0c2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.693+0000 7f4438e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f442c009180 0x7f442c1652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.693+0000 7ff1ae800640 1 -- start start 2024-03-23T23:56:37.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.693+0000 7ff301400640 1 -- start start 2024-03-23T23:56:37.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f4433400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c008850 0x7f442c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f0c6d400640 1 -- 172.21.15.31:0/4121420274 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6802ca80 con 0x7f0c700b3720 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f0c6d400640 1 -- 172.21.15.31:0/4121420274 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6802cc20 con 0x7f0c700b3720 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f0c6d400640 1 -- 172.21.15.31:0/4121420274 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c680343f0 con 0x7f0c700b3720 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f4433400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c008850 0x7f442c0d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60856/0 (socket says 172.21.15.31:60856) 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f4433400640 1 -- 172.21.15.31:0/2594117413 learned_addr learned my addr 172.21.15.31:0/2594117413 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f4433e00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f442c009180 0x7f442c1652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0d80e0 con 0x7f442c009180 2024-03-23T23:56:37.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0d7f60 con 0x7f442c008da0 2024-03-23T23:56:37.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0d8260 con 0x7f442c008850 2024-03-23T23:56:37.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7ff1ae800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1a80b4560 0x7ff1a80b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7ff1ae800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1a80b5000 0x7ff1a80b5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7ff1ae800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80b59d0 con 0x7ff1a80b7200 2024-03-23T23:56:37.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7ff1ae800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80b3dd0 con 0x7ff1a80b5000 2024-03-23T23:56:37.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7ff1ae800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80b9520 con 0x7ff1a80b4560 2024-03-23T23:56:37.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff301400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2fc0b6ca0 0x7ff2fc1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff301400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2fc0b9b10 0x7ff2fc1dd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff301400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc1dd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff301400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b6240 con 0x7ff2fc0b6ca0 2024-03-23T23:56:37.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff301400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b60c0 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff301400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc151a70 con 0x7ff2fc141460 2024-03-23T23:56:37.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ad80d10e0 con 0x7f2ad00c48b0 2024-03-23T23:56:37.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f2ad5600640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f2ab8074c50 0x7f2ab80770f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ab80777c0 con 0x7f2ab8074c50 2024-03-23T23:56:37.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.694+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ad80cfa70 con 0x7f2ad00c48b0 2024-03-23T23:56:37.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7f2addc00640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2ab806bdd0 0x7f2ab806e290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00350a0 tx=0x7f2acc034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff1aca00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1a80b5000 0x7ff1a80b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff1aca00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff1a80b5000 0x7ff1a80b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:60966/0 (socket says 172.21.15.31:60966) 2024-03-23T23:56:37.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff1aca00640 1 -- 172.21.15.31:0/343347855 learned_addr learned my addr 172.21.15.31:0/343347855 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7f0c75000640 1 -- 172.21.15.31:0/4121420274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b3720 msgr2=0x7f0c700b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7f0c75000640 1 --2- 172.21.15.31:0/4121420274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b3720 0x7f0c700b3bb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009e50 tx=0x7f0c6802bee0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7ff1ad400640 1 --2- 172.21.15.31:0/343347855 >> v2:172.21.15.59:3300/0 conn(0x7ff1a80b4560 0x7ff1a80b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.695+0000 7fb190200640 1 Processor -- start 2024-03-23T23:56:37.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7fb190200640 1 -- start start 2024-03-23T23:56:37.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7fec82e00640 1 Processor -- start 2024-03-23T23:56:37.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7ff2f9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2fc0b9b10 0x7ff2fc1dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7f4432a00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 0x7f442c0c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7f4433e00640 1 -- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c008850 msgr2=0x7f442c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7f4433e00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f442c008850 0x7f442c0d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7f4433e00640 1 -- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 msgr2=0x7f442c0c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7f2ade600640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f2ab8074c50 0x7f2ab80770f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7f4433e00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 0x7f442c0c2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7f4433e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0c4070 con 0x7f442c009180 2024-03-23T23:56:37.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7fec82e00640 1 -- start start 2024-03-23T23:56:37.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7ff2f9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2fc0b9b10 0x7ff2fc1dd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45160/0 (socket says 172.21.15.31:45160) 2024-03-23T23:56:37.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.696+0000 7ff2f9e00640 1 -- 172.21.15.31:0/3374312843 learned_addr learned my addr 172.21.15.31:0/3374312843 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7ff2fa800640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2fc0b6ca0 0x7ff2fc1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7f4432a00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f442c008da0 0x7f442c0c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7ff2fb200640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc1dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7ff1ad400640 1 -- 172.21.15.31:0/343347855 >> v2:172.21.15.31:3300/0 conn(0x7ff1a80b5000 msgr2=0x7ff1a80b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7ff1ad400640 1 --2- 172.21.15.31:0/343347855 >> v2:172.21.15.31:3300/0 conn(0x7ff1a80b5000 0x7ff1a80b5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7ff1ad400640 1 -- 172.21.15.31:0/343347855 >> v1:172.21.15.59:6789/0 conn(0x7ff1a80b7200 legacy=0x7ff1a80b7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7ff1ad400640 1 -- 172.21.15.31:0/343347855 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80b83a0 con 0x7ff1a80b4560 2024-03-23T23:56:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7f0c75000640 1 -- 172.21.15.31:0/4121420274 shutdown_connections 2024-03-23T23:56:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7f0c75000640 1 --2- 172.21.15.31:0/4121420274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b3720 0x7f0c700b3bb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7f0c75000640 1 --2- 172.21.15.31:0/4121420274 >> v2:172.21.15.59:3300/0 conn(0x7f0c700b4fa0 0x7f0c700b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7f0c75000640 1 -- 172.21.15.31:0/4121420274 >> 172.21.15.31:0/4121420274 conn(0x7f0c70066fb0 msgr2=0x7f0c700673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7f4433e00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f442c009180 0x7f442c1652e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4434069de0 tx=0x7f4434068b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7fb190200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb188141700 0x7fb188153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7fb190200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1880b9fb0 con 0x7fb188141250 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fb190200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb188141b10 con 0x7fb1880b9bd0 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fb190200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1880b9100 con 0x7fb188141700 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7f0c75000640 1 -- 172.21.15.31:0/4121420274 shutdown_connections 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec82e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fec7c0b1250 0x7fec7c0723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec82e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec7c072910 0x7fec7c155f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec82e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c0b2b10 con 0x7fec7c0b5a70 2024-03-23T23:56:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec82e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c0b2270 con 0x7fec7c0b1250 2024-03-23T23:56:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.697+0000 7f2ade600640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f2ab8074c50 0x7f2ab80770f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec82e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c0b5e50 con 0x7fec7c072910 2024-03-23T23:56:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec7be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fec7c0b5a70 0x7fec7c14eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:48242/0 (socket says 172.21.15.31:48242) 2024-03-23T23:56:37.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec7be00640 1 -- 172.21.15.31:0/3147672214 learned_addr learned my addr 172.21.15.31:0/3147672214 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:37.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fca71600640 1 Processor -- start 2024-03-23T23:56:37.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fb18d800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb1880b9bd0 0x7fb1881473d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:48236/0 (socket says 172.21.15.31:48236) 2024-03-23T23:56:37.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fb18d800640 1 -- 172.21.15.31:0/778651544 learned_addr learned my addr 172.21.15.31:0/778651544 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:37.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fca71600640 1 -- start start 2024-03-23T23:56:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7ff2f9e00640 1 -- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 msgr2=0x7ff2fc1dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7fec73e00640 1 --2- 172.21.15.31:0/3147672214 >> v2:172.21.15.31:3300/0 conn(0x7fec7c0b1250 0x7fec7c0723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7ff2f9e00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2fc141460 0x7ff2fc1dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7ff2f9e00640 1 -- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2fc0b6ca0 msgr2=0x7ff2fc1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7ff2f9e00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2fc0b6ca0 0x7ff2fc1439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7ff2f9e00640 1 -- 172.21.15.31:0/3374312843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc148810 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7ff2fa800640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff2fc0b6ca0 0x7ff2fc1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:37.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146366602 0 0) 0x7fec7c0b2b10 con 0x7fec7c0b5a70 2024-03-23T23:56:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec5c003520 con 0x7fec7c0b5a70 2024-03-23T23:56:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7fec80e00640 1 --2- 172.21.15.31:0/3147672214 >> v2:172.21.15.59:3300/0 conn(0x7fec7c072910 0x7fec7c155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7ff1ad400640 1 --2- 172.21.15.31:0/343347855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 0x7ff1a80b4940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80b6210 tx=0x7ff19402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c21586901e17ed32 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491976648 0 0) 0x7fb188141b10 con 0x7fb1880b9bd0 2024-03-23T23:56:37.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7f0c75000640 1 -- 172.21.15.31:0/4121420274 wait complete. 2024-03-23T23:56:37.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb170003520 con 0x7fb1880b9bd0 2024-03-23T23:56:37.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== osd.0 v2:172.21.15.31:6809/2134439972 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2ab80777c0 con 0x7f2ab8074c50 2024-03-23T23:56:37.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443408f070 con 0x7f442c009180 2024-03-23T23:56:37.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44340734d0 con 0x7f442c009180 2024-03-23T23:56:37.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.698+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443406f070 con 0x7f442c009180 2024-03-23T23:56:37.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c0cf700 con 0x7f442c009180 2024-03-23T23:56:37.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c0c4e50 con 0x7f442c009180 2024-03-23T23:56:37.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.699+0000 7fb18e200640 1 --2- 172.21.15.31:0/778651544 >> v2:172.21.15.31:3300/0 conn(0x7fb188141700 0x7fb188153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 <== mon.1 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3275925821 0 0) 0x7fec5c003520 con 0x7fec7c0b5a70 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 >> v2:172.21.15.59:3300/0 conn(0x7fec7c072910 msgr2=0x7fec7c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 --2- 172.21.15.31:0/3147672214 >> v2:172.21.15.59:3300/0 conn(0x7fec7c072910 0x7fec7c155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 >> v2:172.21.15.31:3300/0 conn(0x7fec7c0b1250 msgr2=0x7fec7c0723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 --2- 172.21.15.31:0/3147672214 >> v2:172.21.15.31:3300/0 conn(0x7fec7c0b1250 0x7fec7c0723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0b2550 con 0x7fec7c0b5a70 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 <== mon.1 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fec64001670 con 0x7fec7c0b5a70 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 >> v1:172.21.15.59:6789/0 conn(0x7fec7c0b5a70 legacy=0x7fec7c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c0039b0 0x7fec5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec5c004800 0x7fec5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec5c0051c0 0x7fec5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0b2270 con 0x7fec5c0039b0 2024-03-23T23:56:37.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0b5e50 con 0x7fec5c004800 2024-03-23T23:56:37.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c00c090 con 0x7fec5c0051c0 2024-03-23T23:56:37.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f442c005710 con 0x7f442c009180 2024-03-23T23:56:37.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7ff1a7e00640 1 -- 172.21.15.31:0/343347855 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1940315a0 con 0x7ff1a80b4560 2024-03-23T23:56:37.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7ff1a7e00640 1 -- 172.21.15.31:0/343347855 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194037070 con 0x7ff1a80b4560 2024-03-23T23:56:37.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7ff1a7e00640 1 -- 172.21.15.31:0/343347855 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194031960 con 0x7ff1a80b4560 2024-03-23T23:56:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fca71600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca6c14bdd0 0x7fca6c14c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fca71600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fca71600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c14c780 con 0x7fca6c06c770 2024-03-23T23:56:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fca71600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c073410 con 0x7fca6c14bdd0 2024-03-23T23:56:37.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fca71600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c072070 con 0x7fca6c1540b0 2024-03-23T23:56:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 <== mon.1 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2698936842 0 0) 0x7fb170003520 con 0x7fb1880b9bd0 2024-03-23T23:56:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 >> v2:172.21.15.31:3300/0 conn(0x7fb188141700 msgr2=0x7fb188153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fb187e00640 1 --2- 172.21.15.31:0/778651544 >> v2:172.21.15.31:3300/0 conn(0x7fb188141700 0x7fb188153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 >> v1:172.21.15.31:6789/0 conn(0x7fb188141250 legacy=0x7fb18814fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880b4310 con 0x7fb1880b9bd0 2024-03-23T23:56:37.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 <== mon.1 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fb17c0019f0 con 0x7fb1880b9bd0 2024-03-23T23:56:37.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.700+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 >> v1:172.21.15.59:6789/0 conn(0x7fb1880b9bd0 legacy=0x7fb1881473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fec80e00640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec5c0051c0 0x7fec5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fec73e00640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec5c004800 0x7fec5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fb187e00640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1700039b0 0x7fb170003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fb187e00640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb170004800 0x7fb170004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fb187e00640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1700052e0 0x7fb17000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880b9100 con 0x7fb170004800 2024-03-23T23:56:37.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fca6b400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17000c230 con 0x7fb1700039b0 2024-03-23T23:56:37.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17000c430 con 0x7fb1700052e0 2024-03-23T23:56:37.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fb18d800640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1700039b0 0x7fb170003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fca6b400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60890/0 (socket says 172.21.15.31:60890) 2024-03-23T23:56:37.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fca6b400640 1 -- 172.21.15.31:0/724009963 learned_addr learned my addr 172.21.15.31:0/724009963 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.701+0000 7ff2f9e00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2fc0b9b10 0x7ff2fc1dd210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c430 tx=0x7ff2e800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fb18ce00640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb170004800 0x7fb170004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fb18e200640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1700052e0 0x7fb17000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7f0c75000640 1 Processor -- start 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7f0c75000640 1 -- start start 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fca6a000640 1 --2- 172.21.15.31:0/724009963 >> v2:172.21.15.31:3300/0 conn(0x7fca6c14bdd0 0x7fca6c14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fca69600640 1 -- 172.21.15.31:0/724009963 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024245962 0 0) 0x7fca6c14c780 con 0x7fca6c06c770 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fca69600640 1 -- 172.21.15.31:0/724009963 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca50003520 con 0x7fca6c06c770 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fca6b400640 1 -- 172.21.15.31:0/724009963 >> v2:172.21.15.31:3300/0 conn(0x7fca6c14bdd0 msgr2=0x7fca6c14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fca6b400640 1 --2- 172.21.15.31:0/724009963 >> v2:172.21.15.31:3300/0 conn(0x7fca6c14bdd0 0x7fca6c14c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fca6b400640 1 -- 172.21.15.31:0/724009963 >> v1:172.21.15.31:6789/0 conn(0x7fca6c06c770 legacy=0x7fca6c072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fca6b400640 1 -- 172.21.15.31:0/724009963 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c06cb50 con 0x7fca6c1540b0 2024-03-23T23:56:37.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8017070 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e80052d0 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7ff301400640 1 -- 172.21.15.31:0/3374312843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc142340 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7ff301400640 1 -- 172.21.15.31:0/3374312843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc1427a0 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7ff1ae800640 1 -- 172.21.15.31:0/343347855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 msgr2=0x7ff1a80b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7ff1ae800640 1 --2- 172.21.15.31:0/343347855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 0x7ff1a80b4940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80b6210 tx=0x7ff19402b840 comp rx=0 tx=0).stop 2024-03-23T23:56:37.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fec73e00640 1 -- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec5c0051c0 msgr2=0x7fec5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fec73e00640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec5c0051c0 0x7fec5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fec73e00640 1 -- 172.21.15.31:0/3147672214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c0039b0 msgr2=0x7fec5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fec73e00640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c0039b0 0x7fec5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.702+0000 7fec73e00640 1 -- 172.21.15.31:0/3147672214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0b2550 con 0x7fec5c004800 2024-03-23T23:56:37.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7f0c75000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c700b3720 0x7f0c70070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fec80e00640 1 -- 172.21.15.31:0/3147672214 reap_dead start 2024-03-23T23:56:37.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7f0c75000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b4fa0 0x7f0c701d1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c75000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700b5890 0x7f0c701d1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c75000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700b40f0 con 0x7f0c700b3720 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c75000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700b2800 con 0x7f0c700b5890 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c75000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700b4270 con 0x7f0c700b4fa0 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c6de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c700b3720 0x7f0c70070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c6de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c700b3720 0x7f0c70070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32768/0 (socket says 172.21.15.31:32768) 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c6de00640 1 -- 172.21.15.31:0/3656804515 learned_addr learned my addr 172.21.15.31:0/3656804515 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7ff1ae800640 1 -- 172.21.15.31:0/343347855 shutdown_connections 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7ff1ae800640 1 --2- 172.21.15.31:0/343347855 >> v2:172.21.15.31:3300/0 conn(0x7ff1a80b5000 0x7ff1a80b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7ff1ae800640 1 --2- 172.21.15.31:0/343347855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 0x7ff1a80b4940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7ff1ae800640 1 -- 172.21.15.31:0/343347855 >> 172.21.15.31:0/343347855 conn(0x7ff1a806cee0 msgr2=0x7ff1a806ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7ff1ae800640 1 -- 172.21.15.31:0/343347855 shutdown_connections 2024-03-23T23:56:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c67e00640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b4fa0 0x7f0c701d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7f0c6e800640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700b5890 0x7f0c701d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7fec73e00640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec5c004800 0x7fec5c004c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009ac0 tx=0x7fec5c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bf44a52f6a85018 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fb18d800640 1 -- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1700052e0 msgr2=0x7fb17000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7ff301400640 1 -- 172.21.15.31:0/3374312843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2fc142ac0 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fb18d800640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1700052e0 0x7fb17000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.703+0000 7fb18d800640 1 -- 172.21.15.31:0/778651544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb170004800 msgr2=0x7fb170004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7fb18d800640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb170004800 0x7fb170004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7fb18d800640 1 -- 172.21.15.31:0/778651544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880b4310 con 0x7fb1700039b0 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.704+0000 7fb18ce00640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb170004800 0x7fb170004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7fb18e200640 1 -- 172.21.15.31:0/778651544 reap_dead start 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7f0c6de00640 1 -- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b4fa0 msgr2=0x7f0c701d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7f0c6de00640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0c700b4fa0 0x7f0c701d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7f0c6de00640 1 -- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700b5890 msgr2=0x7f0c701d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7f0c6de00640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c700b5890 0x7f0c701d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7f0c6de00640 1 -- 172.21.15.31:0/3656804515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c701209f0 con 0x7f0c700b3720 2024-03-23T23:56:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8003830 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4434092070 con 0x7f442c009180 2024-03-23T23:56:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.706+0000 7fb18d800640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1700039b0 0x7fb170003db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00a8c0 tx=0x7fb170005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bba9eede3470f13 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.706+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00a4c0 con 0x7fb1700039b0 2024-03-23T23:56:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.706+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c039070 con 0x7fec5c004800 2024-03-23T23:56:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.706+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c034650 con 0x7fb1700039b0 2024-03-23T23:56:37.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.706+0000 7fb187e00640 1 -- 172.21.15.31:0/778651544 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c034a40 con 0x7fb1700039b0 2024-03-23T23:56:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7fca6b400640 1 --2- 172.21.15.31:0/724009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1564a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca64009e50 tx=0x7fca6402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93be0e8f76660712 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f0c6de00640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c700b3720 0x7f0c70070970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c460 tx=0x7f0c6000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f4427400640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f441406bc10 0x7f441406e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44341056e0 con 0x7f442c009180 2024-03-23T23:56:37.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f4427400640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7f4414073e90 0x7f44140762b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f443406de80 con 0x7f4414073e90 2024-03-23T23:56:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4434105a90 con 0x7f442c009180 2024-03-23T23:56:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.705+0000 7ff1ae800640 1 -- 172.21.15.31:0/343347855 wait complete. 2024-03-23T23:56:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f4432a00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7f4414073e90 0x7f44140762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.706+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c02c710 con 0x7fec5c004800 2024-03-23T23:56:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.706+0000 7fec7b400640 1 -- 172.21.15.31:0/3147672214 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c009690 con 0x7fec5c004800 2024-03-23T23:56:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7fca69600640 1 -- 172.21.15.31:0/724009963 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6402cb00 con 0x7fca6c1540b0 2024-03-23T23:56:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7fca69600640 1 -- 172.21.15.31:0/724009963 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6402cca0 con 0x7fca6c1540b0 2024-03-23T23:56:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60016020 con 0x7f0c700b3720 2024-03-23T23:56:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c60012870 con 0x7f0c700b3720 2024-03-23T23:56:37.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60012c60 con 0x7f0c700b3720 2024-03-23T23:56:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7fec82e00640 1 -- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec5c004800 msgr2=0x7fec5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.707+0000 7fec82e00640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec5c004800 0x7fec5c004c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009ac0 tx=0x7fec5c005830 comp rx=0 tx=0).stop 2024-03-23T23:56:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7fca69600640 1 -- 172.21.15.31:0/724009963 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca640345f0 con 0x7fca6c1540b0 2024-03-23T23:56:37.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7ff1ae800640 1 Processor -- start 2024-03-23T23:56:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7006fd10 con 0x7f0c700b3720 2024-03-23T23:56:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c700712a0 con 0x7f0c700b3720 2024-03-23T23:56:37.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7f4433400640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f441406bc10 0x7f441406e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7fec82e00640 1 -- 172.21.15.31:0/3147672214 shutdown_connections 2024-03-23T23:56:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7fec82e00640 1 --2- 172.21.15.31:0/3147672214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec5c004800 0x7fec5c004c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7fec82e00640 1 -- 172.21.15.31:0/3147672214 >> 172.21.15.31:0/3147672214 conn(0x7fec7c066fb0 msgr2=0x7fec7c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7ff1ae800640 1 -- start start 2024-03-23T23:56:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7fb190200640 1 -- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1700039b0 msgr2=0x7fb170003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.708+0000 7fb190200640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1700039b0 0x7fb170003db0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00a8c0 tx=0x7fb170005830 comp rx=0 tx=0).stop 2024-03-23T23:56:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fca71600640 1 -- 172.21.15.31:0/724009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 msgr2=0x7fca6c1564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fca71600640 1 --2- 172.21.15.31:0/724009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1564a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fca64009e50 tx=0x7fca6402bf60 comp rx=0 tx=0).stop 2024-03-23T23:56:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c7004f400 con 0x7f0c700b3720 2024-03-23T23:56:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fb190200640 1 -- 172.21.15.31:0/778651544 shutdown_connections 2024-03-23T23:56:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fb190200640 1 --2- 172.21.15.31:0/778651544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1700039b0 0x7fb170003db0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fb190200640 1 -- 172.21.15.31:0/778651544 >> 172.21.15.31:0/778651544 conn(0x7fb188066fb0 msgr2=0x7fb1880673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7ff1ae800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 0x7ff1a8094d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7ff1ae800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a80b5000 0x7ff1a809c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7ff1ae800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1a80b7200 0x7ff1a81d40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7ff1ae800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b8c40 con 0x7ff1a80b7200 2024-03-23T23:56:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7ff1ae800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b8960 con 0x7ff1a80b4560 2024-03-23T23:56:37.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7ff1ae800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b64b0 con 0x7ff1a80b5000 2024-03-23T23:56:37.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fca71600640 1 -- 172.21.15.31:0/724009963 shutdown_connections 2024-03-23T23:56:37.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fca71600640 1 --2- 172.21.15.31:0/724009963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1564a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fca71600640 1 --2- 172.21.15.31:0/724009963 >> v2:172.21.15.31:3300/0 conn(0x7fca6c14bdd0 0x7fca6c14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fca71600640 1 -- 172.21.15.31:0/724009963 >> 172.21.15.31:0/724009963 conn(0x7fca6c067820 msgr2=0x7fca6c0baae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fb190200640 1 -- 172.21.15.31:0/778651544 shutdown_connections 2024-03-23T23:56:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fec82e00640 1 -- 172.21.15.31:0/3147672214 shutdown_connections 2024-03-23T23:56:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fb190200640 1 -- 172.21.15.31:0/778651544 wait complete. 2024-03-23T23:56:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.709+0000 7fca71600640 1 -- 172.21.15.31:0/724009963 shutdown_connections 2024-03-23T23:56:37.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.710+0000 7fca71600640 1 -- 172.21.15.31:0/724009963 wait complete. 2024-03-23T23:56:37.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.710+0000 7ff1ade00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1a80b7200 0x7ff1a81d40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.710+0000 7ff1aca00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a80b5000 0x7ff1a809c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.710+0000 7ff1aca00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a80b5000 0x7ff1a809c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60908/0 (socket says 172.21.15.31:60908) 2024-03-23T23:56:37.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.710+0000 7ff1aca00640 1 -- 172.21.15.31:0/4235810134 learned_addr learned my addr 172.21.15.31:0/4235810134 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.710+0000 7ff1ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 0x7ff1a8094d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.711+0000 7ff1ade00640 1 -- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a80b5000 msgr2=0x7ff1a809c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.711+0000 7ff1ade00640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a80b5000 0x7ff1a809c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.711+0000 7ff1ade00640 1 -- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 msgr2=0x7ff1a8094d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.711+0000 7ff1ade00640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a80b4560 0x7ff1a8094d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.711+0000 7ff1ade00640 1 -- 172.21.15.31:0/4235810134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a81e47d0 con 0x7ff1a80b7200 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.712+0000 7ff1ade00640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1a80b7200 0x7ff1a81d40e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000c530 tx=0x7ff1a000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.712+0000 7fca71600640 1 Processor -- start 2024-03-23T23:56:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.711+0000 7f4432a00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7f4414073e90 0x7f44140762b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.712+0000 7fca71600640 1 -- start start 2024-03-23T23:56:37.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.710+0000 7fec82e00640 1 -- 172.21.15.31:0/3147672214 wait complete. 2024-03-23T23:56:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.712+0000 7fec82e00640 1 Processor -- start 2024-03-23T23:56:37.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.713+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== osd.2 v2:172.21.15.31:6808/636958187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f443406de80 con 0x7f4414073e90 2024-03-23T23:56:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.713+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0016020 con 0x7ff1a80b7200 2024-03-23T23:56:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.713+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a0006d50 con 0x7ff1a80b7200 2024-03-23T23:56:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.713+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0003bb0 con 0x7ff1a80b7200 2024-03-23T23:56:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.713+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a81e4ab0 con 0x7ff1a80b7200 2024-03-23T23:56:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.713+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a809cff0 con 0x7ff1a80b7200 2024-03-23T23:56:37.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.712+0000 7fb190200640 1 Processor -- start 2024-03-23T23:56:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.712+0000 7fb190200640 1 -- start start 2024-03-23T23:56:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fb190200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1700039b0 0x7fb18814ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fb190200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1881e1270 0x7fb1881e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fb190200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb18813aec0 0x7fb18813b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fb190200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880b4b10 con 0x7fb1881e1270 2024-03-23T23:56:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fb190200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880b9350 con 0x7fb18813aec0 2024-03-23T23:56:37.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fb190200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880b5010 con 0x7fb1700039b0 2024-03-23T23:56:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7f4433400640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f441406bc10 0x7f441406e0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f442802b690 tx=0x7f4428008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fec82e00640 1 -- start start 2024-03-23T23:56:37.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1a81d0a00 con 0x7ff1a80b7200 2024-03-23T23:56:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.713+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff2e801a070 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fec82e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004800 0x7fec7c147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fb18e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb18813aec0 0x7fb18813b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fb18e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb18813aec0 0x7fb18813b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45226/0 (socket says 172.21.15.31:45226) 2024-03-23T23:56:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fb18e200640 1 -- 172.21.15.31:0/1057727692 learned_addr learned my addr 172.21.15.31:0/1057727692 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fb18e200640 1 -- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1700039b0 msgr2=0x7fb18814ab50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:37.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.712+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0c60019020 con 0x7f0c700b3720 2024-03-23T23:56:37.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7f0c66000640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0c4c06bc50 0x7f0c4c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c6008a940 con 0x7f0c700b3720 2024-03-23T23:56:37.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7f0c66000640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f0c4c073ed0 0x7f0c4c0762f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 --> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c6001eeb0 con 0x7f0c4c073ed0 2024-03-23T23:56:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c6008ae20 con 0x7f0c700b3720 2024-03-23T23:56:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7f0c6e800640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f0c4c073ed0 0x7f0c4c0762f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fb18e200640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1700039b0 0x7fb18814ab50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fb18e200640 1 -- 172.21.15.31:0/1057727692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1881e1270 msgr2=0x7fb1881e16d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca71600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c06c770 0x7fca6c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca71600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca6c14bdd0 0x7fca6c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca71600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca71600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c06e050 con 0x7fca6c14bdd0 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca71600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c06ddb0 con 0x7fca6c06c770 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca71600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c072500 con 0x7fca6c1540b0 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca6aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c06c770 0x7fca6c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca6aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c06c770 0x7fca6c1534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45214/0 (socket says 172.21.15.31:45214) 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.714+0000 7fca6aa00640 1 -- 172.21.15.31:0/3932895452 learned_addr learned my addr 172.21.15.31:0/3932895452 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fca6aa00640 1 -- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 msgr2=0x7fca6c1452a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fca6aa00640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca6c1540b0 0x7fca6c1452a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fca6aa00640 1 -- 172.21.15.31:0/3932895452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca6c14bdd0 msgr2=0x7fca6c150e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T23:56:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fca6aa00640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca6c14bdd0 0x7fca6c150e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.715+0000 7fca6aa00640 1 -- 172.21.15.31:0/3932895452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c152540 con 0x7fca6c06c770 2024-03-23T23:56:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fca6aa00640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c06c770 0x7fca6c1534b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c500 tx=0x7fca5c00c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c017070 con 0x7fca6c06c770 2024-03-23T23:56:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c0052f0 con 0x7fca6c06c770 2024-03-23T23:56:37.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0118b0 con 0x7fca6c06c770 2024-03-23T23:56:37.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7f0c6e800640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f0c4c073ed0 0x7f0c4c0762f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c153ce0 con 0x7fca6c06c770 2024-03-23T23:56:37.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fec82e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec7c1ed7d0 0x7fec7c1dc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.716+0000 7fec82e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec7c1dc580 0x7fec7c145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c14ed60 con 0x7fca6c06c770 2024-03-23T23:56:37.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7ff2f2a00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff2dc06bc20 0x7ff2dc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7fec82e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0affc0 con 0x7fec5c004800 2024-03-23T23:56:37.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7fec82e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0b1ef0 con 0x7fec7c1ed7d0 2024-03-23T23:56:37.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7fec82e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0b0140 con 0x7fec7c1dc580 2024-03-23T23:56:37.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.717+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2e808a020 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7ff2f2a00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7ff2dc073ea0 0x7ff2dc0762c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 --> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2e801feb0 con 0x7ff2dc073ea0 2024-03-23T23:56:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2e808a500 con 0x7ff2fc0b9b10 2024-03-23T23:56:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7ff2fa800640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff2dc06bc20 0x7ff2dc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7ff2fb200640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7ff2dc073ea0 0x7ff2dc0762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7fec7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004800 0x7fec7c147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7fec7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004800 0x7fec7c147080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32780/0 (socket says 172.21.15.31:32780) 2024-03-23T23:56:37.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7fec7be00640 1 -- 172.21.15.31:0/3962856961 learned_addr learned my addr 172.21.15.31:0/3962856961 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:37.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7fb18ce00640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1881e1270 0x7fb1881e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca6c1e5370 con 0x7fca6c06c770 2024-03-23T23:56:37.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7ff2fb200640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7ff2dc073ea0 0x7ff2dc0762c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff1a00050d0 con 0x7ff1a80b7200 2024-03-23T23:56:37.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7f0c67e00640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0c4c06bc50 0x7f0c4c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== osd.3 v2:172.21.15.31:6823/2450082534 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0c6001eeb0 con 0x7f0c4c073ed0 2024-03-23T23:56:37.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7fb18e200640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1881e1270 0x7fb1881e16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.718+0000 7fb18e200640 1 -- 172.21.15.31:0/1057727692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1881e1c10 con 0x7fb18813aec0 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fb18ce00640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1881e1270 0x7fb1881e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fec7be00640 1 -- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec7c1dc580 msgr2=0x7fec7c145b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fec7be00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec7c1dc580 0x7fec7c145b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fec7be00640 1 -- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec7c1ed7d0 msgr2=0x7fec7c1dc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fec73e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec7c1ed7d0 0x7fec7c1dc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fec7be00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec7c1ed7d0 0x7fec7c1dc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fec7be00640 1 -- 172.21.15.31:0/3962856961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c1edf60 con 0x7fec5c004800 2024-03-23T23:56:37.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.719+0000 7fb18e200640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb18813aec0 0x7fb18813b340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1880bdc30 tx=0x7fb18000bb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fec7be00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004800 0x7fec7c147080 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec6400c840 tx=0x7fec6400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7ff1a5600640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff18806bbd0 0x7ff18806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1a008b180 con 0x7ff1a80b7200 2024-03-23T23:56:37.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64018070 con 0x7fec5c004800 2024-03-23T23:56:37.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec640074e0 con 0x7fec5c004800 2024-03-23T23:56:37.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c1ee240 con 0x7fec5c004800 2024-03-23T23:56:37.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c1edc30 con 0x7fec5c004800 2024-03-23T23:56:37.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7ff1a5600640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7ff188073dd0 0x7ff1880761f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 --> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1880768a0 con 0x7ff188073dd0 2024-03-23T23:56:37.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a008b530 con 0x7ff1a80b7200 2024-03-23T23:56:37.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180010780 con 0x7fb18813aec0 2024-03-23T23:56:37.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18001b070 con 0x7fb18813aec0 2024-03-23T23:56:37.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180010b60 con 0x7fb18813aec0 2024-03-23T23:56:37.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.720+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1881439a0 con 0x7fb18813aec0 2024-03-23T23:56:37.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.721+0000 7f0c67e00640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0c4c06bc50 0x7f0c4c06e110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c70124770 tx=0x7f0c58009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.721+0000 7ff1aca00640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7ff188073dd0 0x7ff1880761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.721+0000 7ff1ad400640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff18806bbd0 0x7ff18806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.721+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec7c0b4470 con 0x7fec5c004800 2024-03-23T23:56:37.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.722+0000 7ff2fa800640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff2dc06bc20 0x7ff2dc06e0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009970 tx=0x7ff2ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.722+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64004a20 con 0x7fec5c004800 2024-03-23T23:56:37.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.721+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb188142460 con 0x7fb18813aec0 2024-03-23T23:56:37.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.723+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb18804f400 con 0x7fb18813aec0 2024-03-23T23:56:37.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.722+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== osd.1 v2:172.21.15.31:6800/2615987950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff2e801feb0 con 0x7ff2dc073ea0 2024-03-23T23:56:37.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.723+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fca5c01a070 con 0x7fca6c06c770 2024-03-23T23:56:37.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.724+0000 7ff1aca00640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7ff188073dd0 0x7ff1880761f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.724+0000 7ff1ad400640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff18806bbd0 0x7ff18806e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff194036000 tx=0x7ff19403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.725+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fec6401b070 con 0x7fec5c004800 2024-03-23T23:56:37.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.726+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb180012040 con 0x7fb18813aec0 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.725+0000 7fca62a00640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fca4806bbd0 0x7fca4806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.725+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca5c08a600 con 0x7fca6c06c770 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.725+0000 7fca62a00640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7fca48073dd0 0x7fca480761f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.725+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca480768a0 con 0x7fca48073dd0 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.725+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca5c08a9b0 con 0x7fca6c06c770 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.726+0000 7fca6a000640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fca4806bbd0 0x7fca4806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.726+0000 7fca6b400640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7fca48073dd0 0x7fca480761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.727+0000 7fca6a000640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fca4806bbd0 0x7fca4806e090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca6c1463d0 tx=0x7fca54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.727+0000 7fb185600640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb16806bbd0 0x7fb16806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.727+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb18008b370 con 0x7fb18813aec0 2024-03-23T23:56:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.727+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== osd.4 v2:172.21.15.59:6817/2529462705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff1880768a0 con 0x7ff188073dd0 2024-03-23T23:56:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fb185600640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7fb168073dd0 0x7fb1680761f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 --> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb18000af30 con 0x7fb168073dd0 2024-03-23T23:56:37.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb18008b800 con 0x7fb18813aec0 2024-03-23T23:56:37.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fec78c00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fec5806bc00 0x7fec5806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec6408a280 con 0x7fec5c004800 2024-03-23T23:56:37.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fec78c00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7fec58073e00 0x7fec58076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:37.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec580768d0 con 0x7fec58073e00 2024-03-23T23:56:37.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.728+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec6408a710 con 0x7fec5c004800 2024-03-23T23:56:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.729+0000 7fb18d800640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb16806bbd0 0x7fb16806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.729+0000 7fb18ce00640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7fb168073dd0 0x7fb1680761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.729+0000 7fec73e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fec5806bc00 0x7fec5806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.729+0000 7fec80e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7fec58073e00 0x7fec58076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:37.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.730+0000 7fca6b400640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7fca48073dd0 0x7fca480761f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.730+0000 7fb18ce00640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7fb168073dd0 0x7fb1680761f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.730+0000 7fb18d800640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb16806bbd0 0x7fb16806e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb17c034000 tx=0x7fb17c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.730+0000 7fec80e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7fec58073e00 0x7fec58076220 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.730+0000 7fec73e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fec5806bc00 0x7fec5806e0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec6c036000 tx=0x7fec6c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.732+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== osd.5 v2:172.21.15.59:6800/814178259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fec580768d0 con 0x7fec58073e00 2024-03-23T23:56:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.734+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== osd.7 v2:172.21.15.59:6808/1396029038 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fca480768a0 con 0x7fca48073dd0 2024-03-23T23:56:37.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.734+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== osd.6 v2:172.21.15.59:6816/807447559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb18000af30 con 0x7fb168073dd0 2024-03-23T23:56:37.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.740+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 --> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f442c0c42e0 con 0x7f4414073e90 2024-03-23T23:56:37.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.741+0000 7f4427400640 1 -- 172.21.15.31:0/2594117413 <== osd.2 v2:172.21.15.31:6808/636958187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f442c0c42e0 con 0x7f4414073e90 2024-03-23T23:56:37.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.741+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7f4414073e90 msgr2=0x7f44140762b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.741+0000 7f4438e00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7f4414073e90 0x7f44140762b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f441406bc10 msgr2=0x7f441406e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ad00052c0 con 0x7f2ab8074c50 2024-03-23T23:56:37.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f441406bc10 0x7f441406e0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f442802b690 tx=0x7f4428008030 comp rx=0 tx=0).stop 2024-03-23T23:56:37.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f442c009180 msgr2=0x7f442c1652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 --2- 172.21.15.31:0/2594117413 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f442c009180 0x7f442c1652e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4434069de0 tx=0x7f4434068b90 comp rx=0 tx=0).stop 2024-03-23T23:56:37.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4433e00640 1 -- 172.21.15.31:0/2594117413 reap_dead start 2024-03-23T23:56:37.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 shutdown_connections 2024-03-23T23:56:37.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 >> 172.21.15.31:0/2594117413 conn(0x7f442c03cab0 msgr2=0x7f442c038c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 shutdown_connections 2024-03-23T23:56:37.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.745+0000 7f4438e00640 1 -- 172.21.15.31:0/2594117413 wait complete. 2024-03-23T23:56:37.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.746+0000 7f2ad5600640 1 -- 172.21.15.31:0/3585442524 <== osd.0 v2:172.21.15.31:6809/2134439972 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2ad00052c0 con 0x7f2ab8074c50 2024-03-23T23:56:37.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.747+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f2ab8074c50 msgr2=0x7f2ab80770f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.747+0000 7f2adf000640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f2ab8074c50 0x7f2ab80770f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.750+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 --> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c700706d0 con 0x7f0c4c073ed0 2024-03-23T23:56:37.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.750+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2ab806bdd0 msgr2=0x7f2ab806e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.750+0000 7f2adf000640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2ab806bdd0 0x7f2ab806e290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00350a0 tx=0x7f2acc034000 comp rx=0 tx=0).stop 2024-03-23T23:56:37.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.750+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ad00c48b0 msgr2=0x7f2ad01696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.750+0000 7f2adf000640 1 --2- 172.21.15.31:0/3585442524 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ad00c48b0 0x7f2ad01696c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2ad806a3a0 tx=0x7f2ad806a880 comp rx=0 tx=0).stop 2024-03-23T23:56:37.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.750+0000 7f2ade600640 1 -- 172.21.15.31:0/3585442524 reap_dead start 2024-03-23T23:56:37.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.751+0000 7f0c66000640 1 -- 172.21.15.31:0/3656804515 <== osd.3 v2:172.21.15.31:6823/2450082534 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c700706d0 con 0x7f0c4c073ed0 2024-03-23T23:56:37.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.752+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f0c4c073ed0 msgr2=0x7f0c4c0762f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.752+0000 7f0c75000640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f0c4c073ed0 0x7f0c4c0762f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.752+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 shutdown_connections 2024-03-23T23:56:37.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.752+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 >> 172.21.15.31:0/3585442524 conn(0x7f2ad003a8a0 msgr2=0x7f2ad0036720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.752+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0c4c06bc50 msgr2=0x7f0c4c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 shutdown_connections 2024-03-23T23:56:37.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.752+0000 7f0c75000640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0c4c06bc50 0x7f0c4c06e110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0c70124770 tx=0x7f0c58009190 comp rx=0 tx=0).stop 2024-03-23T23:56:37.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c700b3720 msgr2=0x7f0c70070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f0c75000640 1 --2- 172.21.15.31:0/3656804515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c700b3720 0x7f0c70070970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c460 tx=0x7f0c6000c920 comp rx=0 tx=0).stop 2024-03-23T23:56:37.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f0c6e800640 1 -- 172.21.15.31:0/3656804515 reap_dead start 2024-03-23T23:56:37.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f2adf000640 1 -- 172.21.15.31:0/3585442524 wait complete. 2024-03-23T23:56:37.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 shutdown_connections 2024-03-23T23:56:37.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 >> 172.21.15.31:0/3656804515 conn(0x7f0c70066fb0 msgr2=0x7f0c701d35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 shutdown_connections 2024-03-23T23:56:37.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.753+0000 7f0c75000640 1 -- 172.21.15.31:0/3656804515 wait complete. 2024-03-23T23:56:37.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.755+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 --> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1a80752c0 con 0x7ff188073dd0 2024-03-23T23:56:37.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.756+0000 7ff1a5600640 1 -- 172.21.15.31:0/4235810134 <== osd.4 v2:172.21.15.59:6817/2529462705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff1a80752c0 con 0x7ff188073dd0 2024-03-23T23:56:37.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.756+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7ff188073dd0 msgr2=0x7ff1880761f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.756+0000 7ff1ae800640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7ff188073dd0 0x7ff1880761f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff18806bbd0 msgr2=0x7ff18806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff18806bbd0 0x7ff18806e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff194036000 tx=0x7ff19403d040 comp rx=0 tx=0).stop 2024-03-23T23:56:37.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1a80b7200 msgr2=0x7ff1a81d40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 --2- 172.21.15.31:0/4235810134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1a80b7200 0x7ff1a81d40e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000c530 tx=0x7ff1a000c9f0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ade00640 1 -- 172.21.15.31:0/4235810134 reap_dead start 2024-03-23T23:56:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 shutdown_connections 2024-03-23T23:56:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 >> 172.21.15.31:0/4235810134 conn(0x7ff1a806cee0 msgr2=0x7ff1a806ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 shutdown_connections 2024-03-23T23:56:37.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.759+0000 7ff1ae800640 1 -- 172.21.15.31:0/4235810134 wait complete. 2024-03-23T23:56:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.760+0000 7ff301400640 1 -- 172.21.15.31:0/3374312843 --> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2fc0752c0 con 0x7ff2dc073ea0 2024-03-23T23:56:37.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.761+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fec7c0b31b0 con 0x7fec58073e00 2024-03-23T23:56:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.761+0000 7ff2f2a00640 1 -- 172.21.15.31:0/3374312843 <== osd.1 v2:172.21.15.31:6800/2615987950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2fc0752c0 con 0x7ff2dc073ea0 2024-03-23T23:56:37.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 --> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1881436c0 con 0x7fb168073dd0 2024-03-23T23:56:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.762+0000 7ff2e7e00640 1 -- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7ff2dc073ea0 msgr2=0x7ff2dc0762c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.762+0000 7ff2e7e00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7ff2dc073ea0 0x7ff2dc0762c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.762+0000 7fec78c00640 1 -- 172.21.15.31:0/3962856961 <== osd.5 v2:172.21.15.59:6800/814178259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fec7c0b31b0 con 0x7fec58073e00 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7fec58073e00 msgr2=0x7fec58076220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7fec58073e00 0x7fec58076220 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fec5806bc00 msgr2=0x7fec5806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fec5806bc00 0x7fec5806e0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec6c036000 tx=0x7fec6c030000 comp rx=0 tx=0).stop 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004800 msgr2=0x7fec7c147080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 --2- 172.21.15.31:0/3962856961 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fec5c004800 0x7fec7c147080 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec6400c840 tx=0x7fec6400cd00 comp rx=0 tx=0).stop 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec80e00640 1 -- 172.21.15.31:0/3962856961 reap_dead start 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 shutdown_connections 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.763+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 >> 172.21.15.31:0/3962856961 conn(0x7fec7c066fb0 msgr2=0x7fec7c1e01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2e7e00640 1 -- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff2dc06bc20 msgr2=0x7ff2dc06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2e7e00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff2dc06bc20 0x7ff2dc06e0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009970 tx=0x7ff2ec008040 comp rx=0 tx=0).stop 2024-03-23T23:56:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2e7e00640 1 -- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2fc0b9b10 msgr2=0x7ff2fc1dd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2e7e00640 1 --2- 172.21.15.31:0/3374312843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2fc0b9b10 0x7ff2fc1dd210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c430 tx=0x7ff2e800c8f0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2fb200640 1 -- 172.21.15.31:0/3374312843 reap_dead start 2024-03-23T23:56:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 shutdown_connections 2024-03-23T23:56:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2e7e00640 1 -- 172.21.15.31:0/3374312843 shutdown_connections 2024-03-23T23:56:37.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2e7e00640 1 -- 172.21.15.31:0/3374312843 >> 172.21.15.31:0/3374312843 conn(0x7ff2fc066fb0 msgr2=0x7ff2fc13c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7fec82e00640 1 -- 172.21.15.31:0/3962856961 wait complete. 2024-03-23T23:56:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7ff2e7e00640 1 -- 172.21.15.31:0/3374312843 shutdown_connections 2024-03-23T23:56:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.764+0000 7fb185600640 1 -- 172.21.15.31:0/1057727692 <== osd.6 v2:172.21.15.59:6816/807447559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1881436c0 con 0x7fb168073dd0 2024-03-23T23:56:37.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.765+0000 7ff2e7e00640 1 -- 172.21.15.31:0/3374312843 wait complete. 2024-03-23T23:56:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.765+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7fb168073dd0 msgr2=0x7fb1680761f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.765+0000 7fb190200640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7fb168073dd0 0x7fb1680761f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.765+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb16806bbd0 msgr2=0x7fb16806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.766+0000 7fb190200640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb16806bbd0 0x7fb16806e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb17c034000 tx=0x7fb17c02f000 comp rx=0 tx=0).stop 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.766+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb18813aec0 msgr2=0x7fb18813b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.766+0000 7fb190200640 1 --2- 172.21.15.31:0/1057727692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb18813aec0 0x7fb18813b340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1880bdc30 tx=0x7fb18000bb80 comp rx=0 tx=0).stop 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.766+0000 7fb18e200640 1 -- 172.21.15.31:0/1057727692 reap_dead start 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.766+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 shutdown_connections 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.766+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 >> 172.21.15.31:0/1057727692 conn(0x7fb188066fb0 msgr2=0x7fb188067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.767+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 shutdown_connections 2024-03-23T23:56:37.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.767+0000 7fb190200640 1 -- 172.21.15.31:0/1057727692 wait complete. 2024-03-23T23:56:37.811 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2024-03-23T23:56:37.811 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-23T23:56:37.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.770+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca6c04f400 con 0x7fca48073dd0 2024-03-23T23:56:37.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.771+0000 7fca62a00640 1 -- 172.21.15.31:0/3932895452 <== osd.7 v2:172.21.15.59:6808/1396029038 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca6c04f400 con 0x7fca48073dd0 2024-03-23T23:56:37.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.773+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7fca48073dd0 msgr2=0x7fca480761f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.773+0000 7fca71600640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7fca48073dd0 0x7fca480761f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.774+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fca4806bbd0 msgr2=0x7fca4806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.774+0000 7fca71600640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fca4806bbd0 0x7fca4806e090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca6c1463d0 tx=0x7fca54008040 comp rx=0 tx=0).stop 2024-03-23T23:56:37.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.774+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c06c770 msgr2=0x7fca6c1534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:37.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.774+0000 7fca71600640 1 --2- 172.21.15.31:0/3932895452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca6c06c770 0x7fca6c1534b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c500 tx=0x7fca5c00c9c0 comp rx=0 tx=0).stop 2024-03-23T23:56:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.774+0000 7fca6b400640 1 -- 172.21.15.31:0/3932895452 reap_dead start 2024-03-23T23:56:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.774+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 shutdown_connections 2024-03-23T23:56:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.774+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 >> 172.21.15.31:0/3932895452 conn(0x7fca6c067820 msgr2=0x7fca6c149790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.776+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 shutdown_connections 2024-03-23T23:56:37.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:37.776+0000 7fca71600640 1 -- 172.21.15.31:0/3932895452 wait complete. 2024-03-23T23:56:37.814 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2024-03-23T23:56:37.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-23T23:56:37.815 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2024-03-23T23:56:37.816 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-23T23:56:37.816 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2024-03-23T23:56:37.817 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-23T23:56:37.817 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2024-03-23T23:56:37.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-23T23:56:37.818 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2024-03-23T23:56:37.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-23T23:56:37.819 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2024-03-23T23:56:37.820 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-23T23:56:37.821 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2024-03-23T23:56:37.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-23T23:56:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.160+0000 7f7df9000640 1 Processor -- start 2024-03-23T23:56:38.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.160+0000 7f7df9000640 1 -- start start 2024-03-23T23:56:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.162+0000 7f7df9000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df40b5960 0x7f7df40aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.162+0000 7f7df9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7df40b31d0 0x7f7df414b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.162+0000 7f7df9000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df40b5d40 con 0x7f7df40af690 2024-03-23T23:56:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.162+0000 7f7df9000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df40ae340 con 0x7f7df40b31d0 2024-03-23T23:56:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.162+0000 7f7df9000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40ae620 con 0x7f7df40b5960 2024-03-23T23:56:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.163+0000 7f7df2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7df40b31d0 0x7f7df414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.163+0000 7f7df1400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7df40af690 0x7f7df414aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59452/0 (socket says 172.21.15.31:59452) 2024-03-23T23:56:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.163+0000 7f7df1400640 1 -- 172.21.15.31:0/2866016498 learned_addr learned my addr 172.21.15.31:0/2866016498 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:38.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.163+0000 7f7df1e00640 1 --2- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df40b5960 0x7f7df40aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.164+0000 7f7df2800640 1 -- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df40b5960 msgr2=0x7f7df40aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.164+0000 7f7df2800640 1 --2- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df40b5960 0x7f7df40aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.164+0000 7f7df2800640 1 -- 172.21.15.31:0/2866016498 >> v1:172.21.15.31:6789/0 conn(0x7f7df40af690 legacy=0x7f7df414aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.164+0000 7f7df2800640 1 -- 172.21.15.31:0/2866016498 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40afcd0 con 0x7f7df40b31d0 2024-03-23T23:56:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.164+0000 7fd8b5200640 1 Processor -- start 2024-03-23T23:56:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.165+0000 7fd8b5200640 1 -- start start 2024-03-23T23:56:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.166+0000 7fd8b5200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b013ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.166+0000 7fd8b5200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8b0144bb0 0x7fd8b013e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.166+0000 7fd8b5200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b00713c0 con 0x7fd8b0070fe0 2024-03-23T23:56:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.166+0000 7fd8b5200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b0072230 con 0x7fd8b0144bb0 2024-03-23T23:56:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.166+0000 7fd8b5200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0070400 con 0x7fd8b006ff10 2024-03-23T23:56:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.167+0000 7f8fd2c00640 1 Processor -- start 2024-03-23T23:56:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.167+0000 7f7df2800640 1 --2- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df414b150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009d90 tx=0x7f7dec02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f72ac26c57ae0e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.167+0000 7fd8ae800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8b0144bb0 0x7fd8b013e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.167+0000 7fd8ade00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd8b0070fe0 0x7fd8b01444a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59460/0 (socket says 172.21.15.31:59460) 2024-03-23T23:56:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.167+0000 7fd8ade00640 1 -- 172.21.15.31:0/3366474515 learned_addr learned my addr 172.21.15.31:0/3366474515 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.167+0000 7fd8ad400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b013ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.168+0000 7f7df0a00640 1 -- 172.21.15.31:0/2866016498 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec039070 con 0x7f7df40b31d0 2024-03-23T23:56:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.168+0000 7f7df0a00640 1 -- 172.21.15.31:0/2866016498 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec02cb30 con 0x7f7df40b31d0 2024-03-23T23:56:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.168+0000 7f7df0a00640 1 -- 172.21.15.31:0/2866016498 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec034440 con 0x7f7df40b31d0 2024-03-23T23:56:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.167+0000 7f8fd2c00640 1 -- start start 2024-03-23T23:56:38.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.168+0000 7fd8ae800640 1 -- 172.21.15.31:0/3366474515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 msgr2=0x7fd8b013ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.168+0000 7fd8ae800640 1 --2- 172.21.15.31:0/3366474515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b013ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.168+0000 7fd8ae800640 1 -- 172.21.15.31:0/3366474515 >> v1:172.21.15.31:6789/0 conn(0x7fd8b0070fe0 legacy=0x7fd8b01444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.168+0000 7fd8ae800640 1 -- 172.21.15.31:0/3366474515 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00ba750 con 0x7fd8b0144bb0 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fd2c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fcc0b9bb0 0x7f8fcc0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fd2c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1414b0 0x7f8fcc147780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fd2c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc0b9f90 con 0x7f8fcc1472d0 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fd2c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b5a40 con 0x7f8fcc0b9bb0 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fd2c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b4270 con 0x7f8fcc1414b0 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fcb400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8fcc1472d0 0x7f8fcc140da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59470/0 (socket says 172.21.15.31:59470) 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fcb400640 1 -- 172.21.15.31:0/600161067 learned_addr learned my addr 172.21.15.31:0/600161067 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:38.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/600161067 >> v2:172.21.15.59:3300/0 conn(0x7f8fcc0b9bb0 0x7f8fcc0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f7df9000640 1 -- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 msgr2=0x7f7df414b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.169+0000 7f7df9000640 1 --2- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df414b150 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009d90 tx=0x7f7dec02bd80 comp rx=0 tx=0).stop 2024-03-23T23:56:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.170+0000 7fd8ae800640 1 --2- 172.21.15.31:0/3366474515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b013e330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00097a0 tx=0x7fd8a002b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95cdd0bf1f52796a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.170+0000 7f8fd0c00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1414b0 0x7f8fcc147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.170+0000 7f7df9000640 1 -- 172.21.15.31:0/2866016498 shutdown_connections 2024-03-23T23:56:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.170+0000 7f7df9000640 1 --2- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df414b150 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.170+0000 7f7df9000640 1 --2- 172.21.15.31:0/2866016498 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df40b5960 0x7f7df40aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.170+0000 7f7df9000640 1 -- 172.21.15.31:0/2866016498 >> 172.21.15.31:0/2866016498 conn(0x7f7df4066dd0 msgr2=0x7f7df40671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.170+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668428129 0 0) 0x7f8fcc0b9f90 con 0x7f8fcc1472d0 2024-03-23T23:56:38.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7f7df9000640 1 -- 172.21.15.31:0/2866016498 shutdown_connections 2024-03-23T23:56:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb0003520 con 0x7f8fcc1472d0 2024-03-23T23:56:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7fd8aca00640 1 -- 172.21.15.31:0/3366474515 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0037070 con 0x7fd8b0144bb0 2024-03-23T23:56:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7fd8aca00640 1 -- 172.21.15.31:0/3366474515 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0030710 con 0x7fd8b0144bb0 2024-03-23T23:56:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7fd8aca00640 1 -- 172.21.15.31:0/3366474515 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0030ac0 con 0x7fd8b0144bb0 2024-03-23T23:56:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 -- 172.21.15.31:0/3366474515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 msgr2=0x7fd8b013e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 --2- 172.21.15.31:0/3366474515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b013e330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00097a0 tx=0x7fd8a002b680 comp rx=0 tx=0).stop 2024-03-23T23:56:38.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7f7df9000640 1 -- 172.21.15.31:0/2866016498 wait complete. 2024-03-23T23:56:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 -- 172.21.15.31:0/3366474515 shutdown_connections 2024-03-23T23:56:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 --2- 172.21.15.31:0/3366474515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b013e330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 --2- 172.21.15.31:0/3366474515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b013ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 -- 172.21.15.31:0/3366474515 >> 172.21.15.31:0/3366474515 conn(0x7fd8b00b9890 msgr2=0x7fd8b00b9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 -- 172.21.15.31:0/3366474515 shutdown_connections 2024-03-23T23:56:38.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7fd8b5200640 1 -- 172.21.15.31:0/3366474515 wait complete. 2024-03-23T23:56:38.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335501569 0 0) 0x7f8fb0003520 con 0x7f8fcc1472d0 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1414b0 msgr2=0x7f8fcc147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.171+0000 7f8fcaa00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1414b0 0x7f8fcc147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 >> v2:172.21.15.59:3300/0 conn(0x7f8fcc0b9bb0 msgr2=0x7f8fcc0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 --2- 172.21.15.31:0/600161067 >> v2:172.21.15.59:3300/0 conn(0x7f8fcc0b9bb0 0x7f8fcc0b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0b4550 con 0x7f8fcc1472d0 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f8fbc001670 con 0x7f8fcc1472d0 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 >> v1:172.21.15.31:6789/0 conn(0x7f8fcc1472d0 legacy=0x7f8fcc140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb0004800 0x7f8fb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb00051c0 0x7f8fb00141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b4270 con 0x7f8fb00039b0 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0014710 con 0x7f8fb00051c0 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.172+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0014890 con 0x7f8fb0004800 2024-03-23T23:56:38.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.173+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.174+0000 7fd8b5200640 1 Processor -- start 2024-03-23T23:56:38.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.174+0000 7f8fcb400640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb0004800 0x7f8fb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.174+0000 7f7df9000640 1 Processor -- start 2024-03-23T23:56:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.174+0000 7f8fcbe00640 1 -- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb0004800 msgr2=0x7f8fb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.174+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb0004800 0x7f8fb0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.174+0000 7f8fd0c00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb00051c0 0x7f8fb00141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.174+0000 7f8fcbe00640 1 -- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb00051c0 msgr2=0x7f8fb00141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.175+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb00051c0 0x7f8fb00141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.175+0000 7f8fcbe00640 1 -- 172.21.15.31:0/600161067 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0b4550 con 0x7f8fb00039b0 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f8f8de00640 1 Processor -- start 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.175+0000 7fd8b5200640 1 -- start start 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7fd8b5200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b01339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7fd8b5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b0070fe0 0x7fd8b012f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7fd8b5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b0140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7fd8b5200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0072b20 con 0x7fd8b0070fe0 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7fd8b5200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00729a0 con 0x7fd8b0144bb0 2024-03-23T23:56:38.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7fd8b5200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b006b090 con 0x7fd8b006ff10 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f8f8de00640 1 -- start start 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.175+0000 7f7df9000640 1 -- start start 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f7df9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df40a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f7df9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7df40b5960 0x7f7df40aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f7df9000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df41e1570 0x7f7df41e1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f7df9000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b4f20 con 0x7f7df40b5960 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f7df9000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b3640 con 0x7f7df40b31d0 2024-03-23T23:56:38.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.176+0000 7f7df9000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40ad8f0 con 0x7f7df41e1570 2024-03-23T23:56:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.175+0000 7f8fd0c00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb00051c0 0x7f8fb00141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7fd8ade00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b01339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7fd8ae800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b0140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7f9bca600640 1 Processor -- start 2024-03-23T23:56:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7fd8ae800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b0140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45292/0 (socket says 172.21.15.31:45292) 2024-03-23T23:56:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7fd8ae800640 1 -- 172.21.15.31:0/1397467334 learned_addr learned my addr 172.21.15.31:0/1397467334 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7fd8ad400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b0070fe0 0x7fd8b012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fb0003dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009d30 tx=0x7f8fb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9376f97883d8a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4039070 con 0x7f8fb00039b0 2024-03-23T23:56:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7f7df2800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df41e1570 0x7f7df41e1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7f7df2800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df41e1570 0x7f7df41e1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60970/0 (socket says 172.21.15.31:60970) 2024-03-23T23:56:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7f7df2800640 1 -- 172.21.15.31:0/736003272 learned_addr learned my addr 172.21.15.31:0/736003272 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb402c930 con 0x7f8fb00039b0 2024-03-23T23:56:38.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8fcaa00640 1 -- 172.21.15.31:0/600161067 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4009670 con 0x7f8fb00039b0 2024-03-23T23:56:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f7df1400640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7df40b5960 0x7f7df40aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.177+0000 7f9bca600640 1 -- start start 2024-03-23T23:56:38.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f7df2800640 1 -- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 msgr2=0x7f7df40a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f8de00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f880b5510 0x7f8f88071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f8de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f880727e0 0x7f8f8814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f8de00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f880b46d0 con 0x7f8f880b58f0 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f8de00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f88148f20 con 0x7f8f880b5510 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f8de00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8806f420 con 0x7f8f880727e0 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f86a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f880b5510 0x7f8f88071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f86a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f880b5510 0x7f8f88071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32810/0 (socket says 172.21.15.31:32810) 2024-03-23T23:56:38.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f8f86a00640 1 -- 172.21.15.31:0/3182715670 learned_addr learned my addr 172.21.15.31:0/3182715670 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.178+0000 7f7df1e00640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df40a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8f87400640 1 --2- 172.21.15.31:0/3182715670 >> v2:172.21.15.59:3300/0 conn(0x7f8f880727e0 0x7f8f8814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f7df2800640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df40a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8fd2c00640 1 -- 172.21.15.31:0/600161067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 msgr2=0x7f8fb0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7fd8ad400640 1 -- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 msgr2=0x7fd8b01339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f7df2800640 1 -- 172.21.15.31:0/736003272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7df40b5960 msgr2=0x7f7df40aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8fd2c00640 1 --2- 172.21.15.31:0/600161067 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fb0003dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009d30 tx=0x7f8fb0005830 comp rx=0 tx=0).stop 2024-03-23T23:56:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7fd8ad400640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b01339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f7df2800640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7df40b5960 0x7f7df40aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7fd8ad400640 1 -- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 msgr2=0x7fd8b0140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7fd8ad400640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b0140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f7df2800640 1 -- 172.21.15.31:0/736003272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40aaba0 con 0x7f7df41e1570 2024-03-23T23:56:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f7df1e00640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df40a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8fd0c00640 1 -- 172.21.15.31:0/600161067 reap_dead start 2024-03-23T23:56:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8f86a00640 1 -- 172.21.15.31:0/3182715670 >> v2:172.21.15.59:3300/0 conn(0x7f8f880727e0 msgr2=0x7f8f8814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8f86a00640 1 --2- 172.21.15.31:0/3182715670 >> v2:172.21.15.59:3300/0 conn(0x7f8f880727e0 0x7f8f8814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8f86a00640 1 -- 172.21.15.31:0/3182715670 >> v1:172.21.15.59:6789/0 conn(0x7f8f880b58f0 legacy=0x7f8f88148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f8f86a00640 1 -- 172.21.15.31:0/3182715670 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f880b49b0 con 0x7f8f880b5510 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f9bca600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f9bca600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bc414a830 0x7f9bc40b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f9bca600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc414ac90 con 0x7f9bc41410e0 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f9bca600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40b5850 con 0x7f9bc414a830 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f9bca600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40b9e20 con 0x7f9bc40b5470 2024-03-23T23:56:38.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7fd8ad400640 1 -- 172.21.15.31:0/1397467334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b013f7d0 con 0x7fd8b0070fe0 2024-03-23T23:56:38.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.179+0000 7f7df1400640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7df40b5960 0x7f7df40aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:38.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7fd8ae800640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b0140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:38.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7f9bc2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bc414a830 0x7f9bc40b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7f9bc3e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9bc41410e0 0x7f9bc4147280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59484/0 (socket says 172.21.15.31:59484) 2024-03-23T23:56:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7f9bc3e00640 1 -- 172.21.15.31:0/2794479675 learned_addr learned my addr 172.21.15.31:0/2794479675 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:38.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7fd8ad400640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b0070fe0 0x7fd8b012f550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e850 tx=0x7fd89c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7f9bc3400640 1 --2- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7f7df2800640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df41e1570 0x7f7df41e1a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009eb0 tx=0x7f7dec004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7f8fd2c00640 1 -- 172.21.15.31:0/600161067 shutdown_connections 2024-03-23T23:56:38.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f8fd2c00640 1 -- 172.21.15.31:0/600161067 >> 172.21.15.31:0/600161067 conn(0x7f8fcc067010 msgr2=0x7f8fcc067420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7fd8a6000640 1 -- 172.21.15.31:0/1397467334 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c017070 con 0x7fd8b0070fe0 2024-03-23T23:56:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7fd8a6000640 1 -- 172.21.15.31:0/1397467334 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c00c940 con 0x7fd8b0070fe0 2024-03-23T23:56:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7fd8a6000640 1 -- 172.21.15.31:0/1397467334 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c00cd10 con 0x7fd8b0070fe0 2024-03-23T23:56:38.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f8fd2c00640 1 -- 172.21.15.31:0/600161067 shutdown_connections 2024-03-23T23:56:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f9bc2a00640 1 -- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 msgr2=0x7f9bc40b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f9bc2a00640 1 --2- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc40b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f9bc2a00640 1 -- 172.21.15.31:0/2794479675 >> v1:172.21.15.31:6789/0 conn(0x7f9bc41410e0 legacy=0x7f9bc4147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f9bc2a00640 1 -- 172.21.15.31:0/2794479675 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40ba100 con 0x7f9bc414a830 2024-03-23T23:56:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b0133350 con 0x7fd8b0070fe0 2024-03-23T23:56:38.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f8f86a00640 1 --2- 172.21.15.31:0/3182715670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f88071d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f88068d30 tx=0x7f8f7802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d715cedc553691f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b01317c0 con 0x7fd8b0070fe0 2024-03-23T23:56:38.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f8fd2c00640 1 -- 172.21.15.31:0/600161067 wait complete. 2024-03-23T23:56:38.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.180+0000 7f3785800640 1 Processor -- start 2024-03-23T23:56:38.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f3785800640 1 -- start start 2024-03-23T23:56:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f7dea000640 1 -- 172.21.15.31:0/736003272 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec044020 con 0x7f7df41e1570 2024-03-23T23:56:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f7dea000640 1 -- 172.21.15.31:0/736003272 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec03f470 con 0x7f7df41e1570 2024-03-23T23:56:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.181+0000 7f7dea000640 1 -- 172.21.15.31:0/736003272 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec039040 con 0x7f7df41e1570 2024-03-23T23:56:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.182+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df41e1f60 con 0x7f7df41e1570 2024-03-23T23:56:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.182+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df40aae80 con 0x7f7df41e1570 2024-03-23T23:56:38.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.182+0000 7f8f85600640 1 -- 172.21.15.31:0/3182715670 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78038070 con 0x7f8f880b5510 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f8f85600640 1 -- 172.21.15.31:0/3182715670 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7802f050 con 0x7f8f880b5510 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f8f85600640 1 -- 172.21.15.31:0/3182715670 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78031970 con 0x7f8f880b5510 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.182+0000 7f3785800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37800b6400 0x7f37800b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f3785800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378014ec90 0x7f3780156020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f3785800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800b2370 con 0x7f37800b67e0 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f3785800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800b3430 con 0x7f37800b6400 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f3785800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800b4610 con 0x7f378014ec90 2024-03-23T23:56:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f377fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37800b6400 0x7f37800b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b004f400 con 0x7fd8b0070fe0 2024-03-23T23:56:38.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f8f8de00640 1 -- 172.21.15.31:0/3182715670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 msgr2=0x7f8f88071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f8f8de00640 1 --2- 172.21.15.31:0/3182715670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f88071d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8f88068d30 tx=0x7f8f7802b7f0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f377fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f37800b6400 0x7f37800b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32822/0 (socket says 172.21.15.31:32822) 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f377fe00640 1 -- 172.21.15.31:0/3046228869 learned_addr learned my addr 172.21.15.31:0/3046228869 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.183+0000 7f377f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f37800b67e0 0x7f37800bcd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:48260/0 (socket says 172.21.15.31:48260) 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f8f8de00640 1 -- 172.21.15.31:0/3182715670 shutdown_connections 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f8f8de00640 1 --2- 172.21.15.31:0/3182715670 >> v2:172.21.15.59:3300/0 conn(0x7f8f880727e0 0x7f8f8814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f8f8de00640 1 --2- 172.21.15.31:0/3182715670 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f88071d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f8f8de00640 1 -- 172.21.15.31:0/3182715670 >> 172.21.15.31:0/3182715670 conn(0x7f8f88066fe0 msgr2=0x7f8f880673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f8f8de00640 1 -- 172.21.15.31:0/3182715670 shutdown_connections 2024-03-23T23:56:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f377ea00640 1 -- 172.21.15.31:0/3046228869 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609092174 0 0) 0x7f37800b2370 con 0x7f37800b67e0 2024-03-23T23:56:38.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.184+0000 7f8f8de00640 1 -- 172.21.15.31:0/3182715670 wait complete. 2024-03-23T23:56:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7f377ea00640 1 -- 172.21.15.31:0/3046228869 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3764003520 con 0x7f37800b67e0 2024-03-23T23:56:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7f377fe00640 1 -- 172.21.15.31:0/3046228869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378014ec90 msgr2=0x7f3780156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7f377fe00640 1 --2- 172.21.15.31:0/3046228869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378014ec90 0x7f3780156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7f377fe00640 1 -- 172.21.15.31:0/3046228869 >> v1:172.21.15.59:6789/0 conn(0x7f37800b67e0 legacy=0x7f37800bcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7f377fe00640 1 -- 172.21.15.31:0/3046228869 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800b2650 con 0x7f37800b6400 2024-03-23T23:56:38.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7fd8a6000640 1 -- 172.21.15.31:0/1397467334 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd89c01a070 con 0x7fd8b0070fe0 2024-03-23T23:56:38.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7f9bc2a00640 1 --2- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc414a830 0x7f9bc40b8f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40b5a30 tx=0x7f9bb002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c8245302734bb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.185+0000 7f7afc800640 1 Processor -- start 2024-03-23T23:56:38.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.186+0000 7f7afc800640 1 -- start start 2024-03-23T23:56:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.186+0000 7f9bc2000640 1 -- 172.21.15.31:0/2794479675 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0031780 con 0x7f9bc414a830 2024-03-23T23:56:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f9bc2000640 1 -- 172.21.15.31:0/2794479675 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0037070 con 0x7f9bc414a830 2024-03-23T23:56:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f8f8de00640 1 Processor -- start 2024-03-23T23:56:38.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f9bc2000640 1 -- 172.21.15.31:0/2794479675 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0031b40 con 0x7f9bc414a830 2024-03-23T23:56:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7fd8a6000640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd89006bbd0 0x7fd89006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f377fe00640 1 --2- 172.21.15.31:0/3046228869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37800b2ef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3770009870 tx=0x7f377002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6730b8d9c2d87bd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f7afc800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7af40b6400 0x7f7af40b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f8f8de00640 1 -- start start 2024-03-23T23:56:38.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f7afc800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7af40b67e0 0x7f7af414b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f7afc800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af40b2590 con 0x7f7af414bbf0 2024-03-23T23:56:38.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f7afc800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af40b2100 con 0x7f7af40b67e0 2024-03-23T23:56:38.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7fd8ade00640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd89006bbd0 0x7fd89006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.186+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df404f400 con 0x7f7df41e1570 2024-03-23T23:56:38.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.187+0000 7f7afc800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af40b2de0 con 0x7f7af40b6400 2024-03-23T23:56:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f7af9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7af40b6400 0x7f7af40b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f7afa800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7af414bbf0 0x7f7af414eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59496/0 (socket says 172.21.15.31:59496) 2024-03-23T23:56:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f7afa800640 1 -- 172.21.15.31:0/3430930826 learned_addr learned my addr 172.21.15.31:0/3430930826 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.186+0000 7f8fd2c00640 1 Processor -- start 2024-03-23T23:56:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.186+0000 7f8fd2c00640 1 -- start start 2024-03-23T23:56:38.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f7af9400640 1 --2- 172.21.15.31:0/3430930826 >> v2:172.21.15.31:3300/0 conn(0x7f7af40b67e0 0x7f7af414b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd2c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fcc14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd2c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fcc06ea20 0x7f8fcc1db610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd2c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1dbb50 0x7f8fcc13df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd2c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b9240 con 0x7f8fb00039b0 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd2c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc0b90c0 con 0x7f8fcc06ea20 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd2c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc147780 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd0c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1dbb50 0x7f8fcc13df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd0c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1dbb50 0x7f8fcc13df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60990/0 (socket says 172.21.15.31:60990) 2024-03-23T23:56:38.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.188+0000 7f8fd0c00640 1 -- 172.21.15.31:0/3481980063 learned_addr learned my addr 172.21.15.31:0/3481980063 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8f8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f880727e0 0x7f8f881452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8fcb400640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fcc06ea20 0x7f8fcc1db610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8f8de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f881418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8f8de00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f880b58f0 0x7f8f88141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8f8de00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88072420 con 0x7f8f880b5510 2024-03-23T23:56:38.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8f8de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880722a0 con 0x7f8f880727e0 2024-03-23T23:56:38.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8f8de00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880b4ed0 con 0x7f8f880b58f0 2024-03-23T23:56:38.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7fecf4400640 1 Processor -- start 2024-03-23T23:56:38.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7fd8a6000640 1 -- 172.21.15.31:0/1397467334 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd89c056620 con 0x7fd8b0070fe0 2024-03-23T23:56:38.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fcc14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f7af9e00640 1 -- 172.21.15.31:0/3430930826 >> v2:172.21.15.31:3300/0 conn(0x7f7af40b67e0 msgr2=0x7f7af414b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f7af9e00640 1 --2- 172.21.15.31:0/3430930826 >> v2:172.21.15.31:3300/0 conn(0x7f7af40b67e0 0x7f7af414b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8fd0c00640 1 -- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fcc06ea20 msgr2=0x7f8fcc1db610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8fd0c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fcc06ea20 0x7f8fcc1db610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8fd0c00640 1 -- 172.21.15.31:0/3481980063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 msgr2=0x7f8fcc14ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8fd0c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fcc14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8fd0c00640 1 -- 172.21.15.31:0/3481980063 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc06e600 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f7af9e00640 1 -- 172.21.15.31:0/3430930826 >> v1:172.21.15.31:6789/0 conn(0x7f7af414bbf0 legacy=0x7f7af414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f7af9e00640 1 -- 172.21.15.31:0/3430930826 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40b35c0 con 0x7f7af40b6400 2024-03-23T23:56:38.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7fd8ade00640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd89006bbd0 0x7fd89006e090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80012e0 tx=0x7fd8a8005b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8fcb400640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fcc06ea20 0x7f8fcc1db610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:38.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8f86a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f880727e0 0x7f8f881452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8f86a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f880727e0 0x7f8f881452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45364/0 (socket says 172.21.15.31:45364) 2024-03-23T23:56:38.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8f86a00640 1 -- 172.21.15.31:0/40190345 learned_addr learned my addr 172.21.15.31:0/40190345 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8f87400640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f880b58f0 0x7f8f88141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f8f86000640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f881418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7f7dea000640 1 -- 172.21.15.31:0/736003272 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7dec005d10 con 0x7f7df41e1570 2024-03-23T23:56:38.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f9bca600640 1 -- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc414a830 msgr2=0x7f9bc40b8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.189+0000 7fecf4400640 1 -- start start 2024-03-23T23:56:38.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f9bca600640 1 --2- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc414a830 0x7f9bc40b8f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40b5a30 tx=0x7f9bb002b820 comp rx=0 tx=0).stop 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f8f86000640 1 -- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f880b58f0 msgr2=0x7f8f88141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f8f86000640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f880b58f0 0x7f8f88141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f8f86000640 1 -- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f880727e0 msgr2=0x7f8f881452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f8f86000640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f880727e0 0x7f8f881452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f8f86000640 1 -- 172.21.15.31:0/40190345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8813f440 con 0x7f8f880b5510 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.190+0000 7fecf4400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0b9100 0x7fecec141300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7fecf4400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec0bd590 con 0x7fecec0bd1b0 2024-03-23T23:56:38.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7fecf4400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec0b4440 con 0x7fecec147300 2024-03-23T23:56:38.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7fecf4400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b4a90 con 0x7fecec0b9100 2024-03-23T23:56:38.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7fecf1a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fecec0bd1b0 0x7fecec0b5620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59498/0 (socket says 172.21.15.31:59498) 2024-03-23T23:56:38.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7fecf1a00640 1 -- 172.21.15.31:0/2072103850 learned_addr learned my addr 172.21.15.31:0/2072103850 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:38.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f8fd0c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1dbb50 0x7f8fcc13df80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc141890 tx=0x7f8fc400f4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f8f86000640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f881418c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c3e0 tx=0x7f8f7400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7fecf1000640 1 --2- 172.21.15.31:0/2072103850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0b9100 0x7fecec141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f9bca600640 1 -- 172.21.15.31:0/2794479675 shutdown_connections 2024-03-23T23:56:38.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f9bca600640 1 --2- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc414a830 0x7f9bc40b8f60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f9bca600640 1 --2- 172.21.15.31:0/2794479675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc40b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.191+0000 7f9bca600640 1 -- 172.21.15.31:0/2794479675 >> 172.21.15.31:0/2794479675 conn(0x7f9bc40671f0 msgr2=0x7f9bc4067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.192+0000 7f9bca600640 1 -- 172.21.15.31:0/2794479675 shutdown_connections 2024-03-23T23:56:38.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.192+0000 7f9bca600640 1 -- 172.21.15.31:0/2794479675 wait complete. 2024-03-23T23:56:38.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.192+0000 7fecf1000640 1 -- 172.21.15.31:0/2072103850 >> v1:172.21.15.59:6789/0 conn(0x7fecec147300 legacy=0x7fecec1477b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.192+0000 7fecf1000640 1 -- 172.21.15.31:0/2072103850 >> v1:172.21.15.31:6789/0 conn(0x7fecec0bd1b0 legacy=0x7fecec0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.192+0000 7fecf1000640 1 -- 172.21.15.31:0/2072103850 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0b4720 con 0x7fecec0b9100 2024-03-23T23:56:38.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.192+0000 7f7dea000640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7dd406bca0 0x7f7dd406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.192+0000 7f7dea000640 1 -- 172.21.15.31:0/736003272 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dec0ad550 con 0x7f7df41e1570 2024-03-23T23:56:38.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.193+0000 7f7af9e00640 1 --2- 172.21.15.31:0/3430930826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40b6400 0x7f7af40b9aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7af40b95b0 tx=0x7f7ae802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b1c4ffbf31dc25d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.193+0000 7f7df1e00640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7dd406bca0 0x7f7dd406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.193+0000 7f7af8a00640 1 -- 172.21.15.31:0/3430930826 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80315a0 con 0x7f7af40b6400 2024-03-23T23:56:38.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.193+0000 7f7af8a00640 1 -- 172.21.15.31:0/3430930826 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae8037070 con 0x7f7af40b6400 2024-03-23T23:56:38.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.193+0000 7f7af8a00640 1 -- 172.21.15.31:0/3430930826 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8031960 con 0x7f7af40b6400 2024-03-23T23:56:38.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7fecf1000640 1 --2- 172.21.15.31:0/2072103850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0b9100 0x7fecec141300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecd80097d0 tx=0x7fecd802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f16b93d7d5c40e36 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f9bca600640 1 Processor -- start 2024-03-23T23:56:38.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 -- 172.21.15.31:0/3430930826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40b6400 msgr2=0x7f7af40b9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 --2- 172.21.15.31:0/3430930826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40b6400 0x7f7af40b9aa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7af40b95b0 tx=0x7f7ae802b840 comp rx=0 tx=0).stop 2024-03-23T23:56:38.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7df1e00640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7dd406bca0 0x7f7dd406e160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7de0006fd0 tx=0x7f7de0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 -- 172.21.15.31:0/3430930826 shutdown_connections 2024-03-23T23:56:38.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 --2- 172.21.15.31:0/3430930826 >> v2:172.21.15.31:3300/0 conn(0x7f7af40b67e0 0x7f7af414b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f9bca600640 1 -- start start 2024-03-23T23:56:38.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 --2- 172.21.15.31:0/3430930826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af40b6400 0x7f7af40b9aa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 -- 172.21.15.31:0/3430930826 >> 172.21.15.31:0/3430930826 conn(0x7f7af40671f0 msgr2=0x7f7af4067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 -- 172.21.15.31:0/3430930826 shutdown_connections 2024-03-23T23:56:38.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.194+0000 7f7afc800640 1 -- 172.21.15.31:0/3430930826 wait complete. 2024-03-23T23:56:38.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f377ea00640 1 -- 172.21.15.31:0/3046228869 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770035020 con 0x7f37800b6400 2024-03-23T23:56:38.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f9bca600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc4141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f9bca600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc41410e0 0x7f9bc41e1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f9bca600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bc414a830 0x7f9bc41e1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f9bca600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40b6e20 con 0x7f9bc414a830 2024-03-23T23:56:38.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f9bca600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40b9af0 con 0x7f9bc41410e0 2024-03-23T23:56:38.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f377ea00640 1 -- 172.21.15.31:0/3046228869 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770031640 con 0x7f37800b6400 2024-03-23T23:56:38.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f377ea00640 1 -- 172.21.15.31:0/3046228869 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377002d040 con 0x7f37800b6400 2024-03-23T23:56:38.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f9bca600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40b6fa0 con 0x7f9bc40b5470 2024-03-23T23:56:38.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f8f7f400640 1 -- 172.21.15.31:0/40190345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74017070 con 0x7f8f880b5510 2024-03-23T23:56:38.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f8f7f400640 1 -- 172.21.15.31:0/40190345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f740035f0 con 0x7f8f880b5510 2024-03-23T23:56:38.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7fd8a6000640 1 -- 172.21.15.31:0/1397467334 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd8b013f7d0 con 0x7fd8b0070fe0 2024-03-23T23:56:38.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.195+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880aa2b0 con 0x7f8f880b5510 2024-03-23T23:56:38.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881413a0 con 0x7f8f880b5510 2024-03-23T23:56:38.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f8f7f400640 1 -- 172.21.15.31:0/40190345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740039e0 con 0x7f8f880b5510 2024-03-23T23:56:38.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f9bc3400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc4141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f9bc3400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc4141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:32772/0 (socket says 172.21.15.31:32772) 2024-03-23T23:56:38.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f9bc3400640 1 -- 172.21.15.31:0/3985525157 learned_addr learned my addr 172.21.15.31:0/3985525157 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f9bc2a00640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc41410e0 0x7f9bc41e1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f7afc800640 1 Processor -- start 2024-03-23T23:56:38.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f3785800640 1 -- 172.21.15.31:0/3046228869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 msgr2=0x7f37800b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f3785800640 1 --2- 172.21.15.31:0/3046228869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37800b2ef0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3770009870 tx=0x7f377002b8f0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.196+0000 7f7afc800640 1 -- start start 2024-03-23T23:56:38.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.197+0000 7f9bc3e00640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bc414a830 0x7f9bc41e1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.197+0000 7f9bc2a00640 1 -- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 msgr2=0x7f9bc4141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.197+0000 7f9bc2a00640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc4141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.197+0000 7f9bc2a00640 1 -- 172.21.15.31:0/3985525157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bc414a830 msgr2=0x7f9bc41e1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.197+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f60005290 con 0x7f8f880b5510 2024-03-23T23:56:38.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.197+0000 7f9bc2a00640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bc414a830 0x7f9bc41e1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.197+0000 7f9bc2a00640 1 -- 172.21.15.31:0/3985525157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40baf30 con 0x7f9bc41410e0 2024-03-23T23:56:38.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f3785800640 1 -- 172.21.15.31:0/3046228869 shutdown_connections 2024-03-23T23:56:38.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f3785800640 1 --2- 172.21.15.31:0/3046228869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f378014ec90 0x7f3780156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f3785800640 1 --2- 172.21.15.31:0/3046228869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37800b2ef0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f3785800640 1 -- 172.21.15.31:0/3046228869 >> 172.21.15.31:0/3046228869 conn(0x7f3780066fb0 msgr2=0x7f3780067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f3785800640 1 -- 172.21.15.31:0/3046228869 shutdown_connections 2024-03-23T23:56:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f3785800640 1 -- 172.21.15.31:0/3046228869 wait complete. 2024-03-23T23:56:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7afc800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af40b6400 0x7f7af41e4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7afc800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af40b67e0 0x7f7af41e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7afc800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af414bbf0 0x7f7af413a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7afc800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40b3b40 con 0x7f7af40b67e0 2024-03-23T23:56:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7afc800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40b9040 con 0x7f7af414bbf0 2024-03-23T23:56:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7afc800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40b3cc0 con 0x7f7af40b6400 2024-03-23T23:56:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f9bc2a00640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc41410e0 0x7f9bc41e1550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0033000 tx=0x7f9bb00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7af9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af40b67e0 0x7f7af41e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7af9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af40b67e0 0x7f7af41e4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32878/0 (socket says 172.21.15.31:32878) 2024-03-23T23:56:38.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f7af9400640 1 -- 172.21.15.31:0/2402854519 learned_addr learned my addr 172.21.15.31:0/2402854519 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.198+0000 7f9bbb400640 1 -- 172.21.15.31:0/3985525157 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0032820 con 0x7f9bc41410e0 2024-03-23T23:56:38.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f9bbb400640 1 -- 172.21.15.31:0/3985525157 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb00329c0 con 0x7f9bc41410e0 2024-03-23T23:56:38.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f9bbb400640 1 -- 172.21.15.31:0/3985525157 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0032db0 con 0x7f9bc41410e0 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f7af9e00640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af40b6400 0x7f7af41e4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f7afa800640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af414bbf0 0x7f7af413a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f7af9400640 1 -- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af40b6400 msgr2=0x7f7af41e4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f7af9400640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af40b6400 0x7f7af41e4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f7af9400640 1 -- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af414bbf0 msgr2=0x7f7af413a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f7af9400640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af414bbf0 0x7f7af413a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f7af9400640 1 -- 172.21.15.31:0/2402854519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af413c420 con 0x7f7af40b67e0 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.200+0000 7f7af9400640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af40b67e0 0x7f7af41e4d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009fd0 tx=0x7f7ae400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc4143510 con 0x7f9bc41410e0 2024-03-23T23:56:38.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.200+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc40bac50 con 0x7f9bc41410e0 2024-03-23T23:56:38.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.199+0000 7f8f7f400640 1 -- 172.21.15.31:0/40190345 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8f7401a070 con 0x7f8f880b5510 2024-03-23T23:56:38.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.200+0000 7f3785800640 1 Processor -- start 2024-03-23T23:56:38.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.200+0000 7f3785800640 1 -- start start 2024-03-23T23:56:38.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.200+0000 7f8f7f400640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8f6806bc20 0x7f8f6806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f8f7f400640 1 -- 172.21.15.31:0/40190345 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f74089b10 con 0x7f8f880b5510 2024-03-23T23:56:38.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc4143340 con 0x7f9bc41410e0 2024-03-23T23:56:38.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f3785800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37801478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f3785800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37800b67e0 0x7f3780148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f3785800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378014ec90 0x7f3780143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f3785800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800b2b70 con 0x7f37800b6400 2024-03-23T23:56:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f3785800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800b3650 con 0x7f378014ec90 2024-03-23T23:56:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f3785800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3780146490 con 0x7f37800b67e0 2024-03-23T23:56:38.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.201+0000 7f8f86a00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8f6806bc20 0x7f8f6806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.202+0000 7f377fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37801478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.202+0000 7f377fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37801478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32890/0 (socket says 172.21.15.31:32890) 2024-03-23T23:56:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.202+0000 7f377fe00640 1 -- 172.21.15.31:0/2090130380 learned_addr learned my addr 172.21.15.31:0/2090130380 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.202+0000 7f3784e00640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378014ec90 0x7f3780143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.203+0000 7f8f86a00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8f6806bc20 0x7f8f6806e0e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009630 tx=0x7f8f78008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.203+0000 7f9bbb400640 1 -- 172.21.15.31:0/3985525157 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9bb004e430 con 0x7f9bc41410e0 2024-03-23T23:56:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.202+0000 7f377fe00640 1 -- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37800b67e0 msgr2=0x7f3780148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.202+0000 7f377f400640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37800b67e0 0x7f3780148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.203+0000 7f377fe00640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37800b67e0 0x7f3780148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f377fe00640 1 -- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378014ec90 msgr2=0x7f3780143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f377fe00640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378014ec90 0x7f3780143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f377fe00640 1 -- 172.21.15.31:0/2090130380 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780149740 con 0x7f37800b6400 2024-03-23T23:56:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f3784e00640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378014ec90 0x7f3780143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f377f400640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37800b67e0 0x7f3780148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:38.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f377fe00640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37801478c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3770000c00 tx=0x7f37700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f9bbb400640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9ba406bbd0 0x7f9ba406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.204+0000 7f9bbb400640 1 -- 172.21.15.31:0/3985525157 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bb00ace90 con 0x7f9bc41410e0 2024-03-23T23:56:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.205+0000 7f9bc3400640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9ba406bbd0 0x7f9ba406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.205+0000 7f3777e00640 1 -- 172.21.15.31:0/2090130380 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770035040 con 0x7f37800b6400 2024-03-23T23:56:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f3777e00640 1 -- 172.21.15.31:0/2090130380 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770003820 con 0x7f37800b6400 2024-03-23T23:56:38.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3780147e60 con 0x7f37800b6400 2024-03-23T23:56:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f7aee000640 1 -- 172.21.15.31:0/2402854519 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4017070 con 0x7f7af40b67e0 2024-03-23T23:56:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f7aee000640 1 -- 172.21.15.31:0/2402854519 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae400c940 con 0x7f7af40b67e0 2024-03-23T23:56:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f7aee000640 1 -- 172.21.15.31:0/2402854519 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400cd10 con 0x7f7af40b67e0 2024-03-23T23:56:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3780148b20 con 0x7f37800b6400 2024-03-23T23:56:38.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af413c700 con 0x7f7af40b67e0 2024-03-23T23:56:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f3777e00640 1 -- 172.21.15.31:0/2090130380 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700044e0 con 0x7f37800b6400 2024-03-23T23:56:38.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af413e100 con 0x7f7af40b67e0 2024-03-23T23:56:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.206+0000 7f8f7f400640 1 -- 172.21.15.31:0/40190345 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f8f740581e0 con 0x7f8f880b5510 2024-03-23T23:56:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.207+0000 7f9bc3400640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9ba406bbd0 0x7f9ba406e090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4006fd0 tx=0x7f9bb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.207+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3780074bd0 con 0x7f37800b6400 2024-03-23T23:56:38.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.209+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af404f400 con 0x7f7af40b67e0 2024-03-23T23:56:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.209+0000 7f7aee000640 1 -- 172.21.15.31:0/2402854519 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7ae401a070 con 0x7f7af40b67e0 2024-03-23T23:56:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.209+0000 7f3777e00640 1 -- 172.21.15.31:0/2090130380 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3770038020 con 0x7f37800b6400 2024-03-23T23:56:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.210+0000 7f7aee000640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7ad806bbd0 0x7f7ad806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.210+0000 7f3777e00640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f376006bca0 0x7f376006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.210+0000 7f3777e00640 1 -- 172.21.15.31:0/2090130380 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37700ac650 con 0x7f37800b6400 2024-03-23T23:56:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.210+0000 7f7aee000640 1 -- 172.21.15.31:0/2402854519 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ae408add0 con 0x7f7af40b67e0 2024-03-23T23:56:38.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.210+0000 7f7af9e00640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7ad806bbd0 0x7f7ad806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7f377f400640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f376006bca0 0x7f376006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7f8fc3e00640 1 -- 172.21.15.31:0/3481980063 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc401c070 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7f8fc3e00640 1 -- 172.21.15.31:0/3481980063 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc4017400 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7f8fc3e00640 1 -- 172.21.15.31:0/3481980063 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40177d0 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7f7dea000640 1 -- 172.21.15.31:0/736003272 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f7dec04e070 con 0x7f7df41e1570 2024-03-23T23:56:38.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7fecebe00640 1 -- 172.21.15.31:0/2072103850 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8035020 con 0x7fecec0b9100 2024-03-23T23:56:38.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7fecebe00640 1 -- 172.21.15.31:0/2072103850 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd8031810 con 0x7fecec0b9100 2024-03-23T23:56:38.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.211+0000 7fecebe00640 1 -- 172.21.15.31:0/2072103850 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8031be0 con 0x7fecec0b9100 2024-03-23T23:56:38.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7f7af9e00640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7ad806bbd0 0x7f7ad806e090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8036000 tx=0x7f7ae803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fcc143d50 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc13e4c0 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7fecf4400640 1 -- 172.21.15.31:0/2072103850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0b9100 msgr2=0x7fecec141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7fecf4400640 1 --2- 172.21.15.31:0/2072103850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0b9100 0x7fecec141300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecd80097d0 tx=0x7fecd802b8b0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7fecf4400640 1 -- 172.21.15.31:0/2072103850 shutdown_connections 2024-03-23T23:56:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7fecf4400640 1 --2- 172.21.15.31:0/2072103850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0b9100 0x7fecec141300 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.212+0000 7fecf4400640 1 -- 172.21.15.31:0/2072103850 >> 172.21.15.31:0/2072103850 conn(0x7fecec066fb0 msgr2=0x7fecec0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.213+0000 7fecf4400640 1 -- 172.21.15.31:0/2072103850 shutdown_connections 2024-03-23T23:56:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.213+0000 7fecf4400640 1 -- 172.21.15.31:0/2072103850 wait complete. 2024-03-23T23:56:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.213+0000 7f377f400640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f376006bca0 0x7f376006e160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f378013b9a0 tx=0x7f376c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.214+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc04f400 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.215+0000 7fecf4400640 1 Processor -- start 2024-03-23T23:56:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.215+0000 7fecf4400640 1 -- start start 2024-03-23T23:56:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.216+0000 7f8fc3e00640 1 -- 172.21.15.31:0/3481980063 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8fc401f070 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.216+0000 7fecf4400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecec0b9100 0x7fecec14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.216+0000 7fecf4400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0bd1b0 0x7fecec1dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.216+0000 7fecf4400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec147300 0x7fecec1ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.216+0000 7fecf4400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec152c90 con 0x7fecec0b9100 2024-03-23T23:56:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.216+0000 7fecf4400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec141a50 con 0x7fecec147300 2024-03-23T23:56:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.216+0000 7fecf4400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec152e10 con 0x7fecec0bd1b0 2024-03-23T23:56:38.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.217+0000 7f3777e00640 1 -- 172.21.15.31:0/2090130380 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f377007b1b0 con 0x7f37800b6400 2024-03-23T23:56:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.217+0000 7fecf1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecec0b9100 0x7fecec14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.217+0000 7fecf1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecec0b9100 0x7fecec14a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32896/0 (socket says 172.21.15.31:32896) 2024-03-23T23:56:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.217+0000 7fecf1a00640 1 -- 172.21.15.31:0/3532107186 learned_addr learned my addr 172.21.15.31:0/3532107186 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.218+0000 7fecf2400640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec147300 0x7fecec1ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.218+0000 7fecf1000640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0bd1b0 0x7fecec1dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.218+0000 7f8fc3e00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8fa806bc50 0x7f8fa806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7fecf1a00640 1 -- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0bd1b0 msgr2=0x7fecec1dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7fecf1a00640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0bd1b0 0x7fecec1dd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7fecf1a00640 1 -- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec147300 msgr2=0x7fecec1ddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7fecf1a00640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec147300 0x7fecec1ddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7fecf1a00640 1 -- 172.21.15.31:0/3532107186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec141ed0 con 0x7fecec0b9100 2024-03-23T23:56:38.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7f8fc3e00640 1 -- 172.21.15.31:0/3481980063 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fc40570e0 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7fecf1a00640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecec0b9100 0x7fecec14a580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fece000c400 tx=0x7fece000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.219+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8fa806bc50 0x7f8fa806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.221+0000 7f8fcbe00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8fa806bc50 0x7f8fa806e110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4036000 tx=0x7f8fb4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.222+0000 7f9bbb400640 1 -- 172.21.15.31:0/3985525157 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9bb0040070 con 0x7f9bc41410e0 2024-03-23T23:56:38.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.224+0000 7f7aee000640 1 -- 172.21.15.31:0/2402854519 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f7ae40598b0 con 0x7f7af40b67e0 2024-03-23T23:56:38.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.224+0000 7fece9600640 1 -- 172.21.15.31:0/3532107186 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0017070 con 0x7fecec0b9100 2024-03-23T23:56:38.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.224+0000 7fece9600640 1 -- 172.21.15.31:0/3532107186 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0005ce0 con 0x7fecec0b9100 2024-03-23T23:56:38.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.224+0000 7fece9600640 1 -- 172.21.15.31:0/3532107186 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0017070 con 0x7fecec0b9100 2024-03-23T23:56:38.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.224+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec138930 con 0x7fecec0b9100 2024-03-23T23:56:38.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.224+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec1484c0 con 0x7fecec0b9100 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.225+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec145830 con 0x7fecec0b9100 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.228+0000 7fece9600640 1 -- 172.21.15.31:0/3532107186 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fece001a070 con 0x7fecec0b9100 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.230+0000 7fece9600640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7feccc06bdd0 0x7feccc06e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.230+0000 7fece9600640 1 -- 172.21.15.31:0/3532107186 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fece00076e0 con 0x7fecec0b9100 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.230+0000 7fecf1000640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7feccc06bdd0 0x7feccc06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.232+0000 7fecf1000640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7feccc06bdd0 0x7feccc06e290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fecd8036000 tx=0x7fecd803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.234+0000 7fece9600640 1 -- 172.21.15.31:0/3532107186 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fecec145830 con 0x7fecec0b9100 2024-03-23T23:56:38.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.236+0000 7f8fc3e00640 1 -- 172.21.15.31:0/3481980063 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f8fc4012070 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.634+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd8b006c600 con 0x7fd8b0070fe0 2024-03-23T23:56:38.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.634+0000 7fd8a6000640 1 -- 172.21.15.31:0/1397467334 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd89c058580 con 0x7fd8b0070fe0 2024-03-23T23:56:38.635 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2024-03-23T23:56:38.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.638+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd89006bbd0 msgr2=0x7fd89006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.638+0000 7fd8b5200640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd89006bbd0 0x7fd89006e090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80012e0 tx=0x7fd8a8005b70 comp rx=0 tx=0).stop 2024-03-23T23:56:38.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.638+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b0070fe0 msgr2=0x7fd8b012f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.638+0000 7fd8b5200640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b0070fe0 0x7fd8b012f550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00e850 tx=0x7fd89c00ed10 comp rx=0 tx=0).stop 2024-03-23T23:56:38.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.639+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 shutdown_connections 2024-03-23T23:56:38.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.639+0000 7fd8b5200640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd89006bbd0 0x7fd89006e090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.639+0000 7fd8b5200640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b0144bb0 0x7fd8b0140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.639+0000 7fd8b5200640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8b0070fe0 0x7fd8b012f550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.639+0000 7fd8b5200640 1 --2- 172.21.15.31:0/1397467334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006ff10 0x7fd8b01339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.639+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 >> 172.21.15.31:0/1397467334 conn(0x7fd8b00b9890 msgr2=0x7fd8b0068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.640+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 shutdown_connections 2024-03-23T23:56:38.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.640+0000 7fd8b5200640 1 -- 172.21.15.31:0/1397467334 wait complete. 2024-03-23T23:56:38.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.650+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8f60005850 con 0x7f8f880b5510 2024-03-23T23:56:38.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.651+0000 7f8f7f400640 1 -- 172.21.15.31:0/40190345 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f7405c280 con 0x7f8f880b5510 2024-03-23T23:56:38.658 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2024-03-23T23:56:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.654+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8f6806bc20 msgr2=0x7f8f6806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.654+0000 7f8f8de00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8f6806bc20 0x7f8f6806e0e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009630 tx=0x7f8f78008030 comp rx=0 tx=0).stop 2024-03-23T23:56:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.654+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 msgr2=0x7f8f881418c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.654+0000 7f8f8de00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f881418c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400c3e0 tx=0x7f8f7400c8a0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.655+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 shutdown_connections 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.655+0000 7f8f8de00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8f6806bc20 0x7f8f6806e0e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.655+0000 7f8f8de00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f880b58f0 0x7f8f88141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.655+0000 7f8f8de00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f880b5510 0x7f8f881418c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.655+0000 7f8f8de00640 1 --2- 172.21.15.31:0/40190345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f880727e0 0x7f8f881452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.655+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 >> 172.21.15.31:0/40190345 conn(0x7f8f88066fe0 msgr2=0x7f8f880b8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.656+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 shutdown_connections 2024-03-23T23:56:38.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.656+0000 7f8f8de00640 1 -- 172.21.15.31:0/40190345 wait complete. 2024-03-23T23:56:38.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.656+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7df40b8140 con 0x7f7df41e1570 2024-03-23T23:56:38.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.657+0000 7f7dea000640 1 -- 172.21.15.31:0/736003272 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7df41e1f60 con 0x7f7df41e1570 2024-03-23T23:56:38.661 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2024-03-23T23:56:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7dd406bca0 msgr2=0x7f7dd406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7dd406bca0 0x7f7dd406e160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7de0006fd0 tx=0x7f7de0008040 comp rx=0 tx=0).stop 2024-03-23T23:56:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df41e1570 msgr2=0x7f7df41e1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df41e1570 0x7f7df41e1a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009eb0 tx=0x7f7dec004a40 comp rx=0 tx=0).stop 2024-03-23T23:56:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 shutdown_connections 2024-03-23T23:56:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7dd406bca0 0x7f7dd406e160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7df41e1570 0x7f7df41e1a20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7df40b5960 0x7f7df40aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 --2- 172.21.15.31:0/736003272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7df40b31d0 0x7f7df40a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.661+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 >> 172.21.15.31:0/736003272 conn(0x7f7df4066dd0 msgr2=0x7f7df40b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.662+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 shutdown_connections 2024-03-23T23:56:38.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.662+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9bc40b5e10 con 0x7f9bc41410e0 2024-03-23T23:56:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.662+0000 7f7df9000640 1 -- 172.21.15.31:0/736003272 wait complete. 2024-03-23T23:56:38.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.663+0000 7f9bbb400640 1 -- 172.21.15.31:0/3985525157 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9bc40b5e10 con 0x7f9bc41410e0 2024-03-23T23:56:38.666 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2024-03-23T23:56:38.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-03-23T23:56:38.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37800752c0 con 0x7f37800b6400 2024-03-23T23:56:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9ba406bbd0 msgr2=0x7f9ba406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9ba406bbd0 0x7f9ba406e090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4006fd0 tx=0x7f9bb4008040 comp rx=0 tx=0).stop 2024-03-23T23:56:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc41410e0 msgr2=0x7f9bc41e1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc41410e0 0x7f9bc41e1550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0033000 tx=0x7f9bb00046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 shutdown_connections 2024-03-23T23:56:38.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9ba406bbd0 0x7f9ba406e090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc41410e0 0x7f9bc41e1550 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0033000 tx=0x7f9bb00046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.667+0000 7f9bca600640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bc414a830 0x7f9bc41e1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.668+0000 7f9bca600640 1 --2- 172.21.15.31:0/3985525157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bc40b5470 0x7f9bc4141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.668+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 >> 172.21.15.31:0/3985525157 conn(0x7f9bc40671f0 msgr2=0x7f9bc4148610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.668+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 shutdown_connections 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.668+0000 7f9bca600640 1 -- 172.21.15.31:0/3985525157 wait complete. 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.668+0000 7f3777e00640 1 -- 172.21.15.31:0/2090130380 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f377007aab0 con 0x7f37800b6400 2024-03-23T23:56:38.671 INFO:teuthology.orchestra.run.smithi031.stdout:55834574852 2024-03-23T23:56:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f376006bca0 msgr2=0x7f376006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f376006bca0 0x7f376006e160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f378013b9a0 tx=0x7f376c009040 comp rx=0 tx=0).stop 2024-03-23T23:56:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 msgr2=0x7f37801478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37801478c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3770000c00 tx=0x7f37700046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 shutdown_connections 2024-03-23T23:56:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f376006bca0 0x7f376006e160 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f378014ec90 0x7f3780143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37800b67e0 0x7f3780148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 --2- 172.21.15.31:0/2090130380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f37800b6400 0x7f37801478c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 >> 172.21.15.31:0/2090130380 conn(0x7f3780066fb0 msgr2=0x7f3780067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 shutdown_connections 2024-03-23T23:56:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.672+0000 7f3785800640 1 -- 172.21.15.31:0/2090130380 wait complete. 2024-03-23T23:56:38.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.674+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fecec148f90 con 0x7fecec0b9100 2024-03-23T23:56:38.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.675+0000 7fece9600640 1 -- 172.21.15.31:0/3532107186 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fece0058630 con 0x7fecec0b9100 2024-03-23T23:56:38.682 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2024-03-23T23:56:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.676+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7af40bb930 con 0x7f7af40b67e0 2024-03-23T23:56:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.678+0000 7f7aee000640 1 -- 172.21.15.31:0/2402854519 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ae40591b0 con 0x7f7af40b67e0 2024-03-23T23:56:38.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.678+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7feccc06bdd0 msgr2=0x7feccc06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.678+0000 7fecf4400640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7feccc06bdd0 0x7feccc06e290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fecd8036000 tx=0x7fecd803c040 comp rx=0 tx=0).stop 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.678+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecec0b9100 msgr2=0x7fecec14a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.678+0000 7fecf4400640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecec0b9100 0x7fecec14a580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fece000c400 tx=0x7fece000c8c0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.679+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 shutdown_connections 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.679+0000 7fecf4400640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7feccc06bdd0 0x7feccc06e290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.679+0000 7fecf4400640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec147300 0x7fecec1ddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.679+0000 7fecf4400640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0bd1b0 0x7fecec1dd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.679+0000 7fecf4400640 1 --2- 172.21.15.31:0/3532107186 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fecec0b9100 0x7fecec14a580 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.679+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 >> 172.21.15.31:0/3532107186 conn(0x7fecec066fb0 msgr2=0x7fecec0b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.685 INFO:teuthology.orchestra.run.smithi031.stdout:55834574852 2024-03-23T23:56:38.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.679+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 shutdown_connections 2024-03-23T23:56:38.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.681+0000 7fecf4400640 1 -- 172.21.15.31:0/3532107186 wait complete. 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.682+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7ad806bbd0 msgr2=0x7f7ad806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.682+0000 7f7afc800640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7ad806bbd0 0x7f7ad806e090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8036000 tx=0x7f7ae803d040 comp rx=0 tx=0).stop 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af40b67e0 msgr2=0x7f7af41e4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af40b67e0 0x7f7af41e4d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009fd0 tx=0x7f7ae400ed40 comp rx=0 tx=0).stop 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 shutdown_connections 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7ad806bbd0 0x7f7ad806e090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7af414bbf0 0x7f7af413a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7af40b67e0 0x7f7af41e4d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 --2- 172.21.15.31:0/2402854519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7af40b6400 0x7f7af41e4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 >> 172.21.15.31:0/2402854519 conn(0x7f7af40671f0 msgr2=0x7f7af40baa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 shutdown_connections 2024-03-23T23:56:38.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.683+0000 7f7afc800640 1 -- 172.21.15.31:0/2402854519 wait complete. 2024-03-23T23:56:38.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.684+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8fcc067750 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-03-23T23:56:38.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.687+0000 7f8fc3e00640 1 -- 172.21.15.31:0/3481980063 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fc4059740 con 0x7f8fcc1dbb50 2024-03-23T23:56:38.690 INFO:teuthology.orchestra.run.smithi031.stdout:55834574852 2024-03-23T23:56:38.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-03-23T23:56:38.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.690+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8fa806bc50 msgr2=0x7f8fa806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.690+0000 7f8fd2c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8fa806bc50 0x7f8fa806e110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4036000 tx=0x7f8fb4030000 comp rx=0 tx=0).stop 2024-03-23T23:56:38.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.690+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1dbb50 msgr2=0x7f8fcc13df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:38.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.690+0000 7f8fd2c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1dbb50 0x7f8fcc13df80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc141890 tx=0x7f8fc400f4a0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 shutdown_connections 2024-03-23T23:56:38.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8fa806bc50 0x7f8fa806e110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fcc06ea20 0x7f8fcc1db610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fcc1dbb50 0x7f8fcc13df80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 --2- 172.21.15.31:0/3481980063 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8fb00039b0 0x7f8fcc14ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:38.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 >> 172.21.15.31:0/3481980063 conn(0x7f8fcc067010 msgr2=0x7f8fcc140060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:38.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 shutdown_connections 2024-03-23T23:56:38.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:38.691+0000 7f8fd2c00640 1 -- 172.21.15.31:0/3481980063 wait complete. 2024-03-23T23:56:38.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-03-23T23:56:38.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-23T23:56:38.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-03-23T23:56:38.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-03-23T23:56:38.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-03-23T23:56:39.671 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-23T23:56:39.690 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-23T23:56:39.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-23T23:56:39.694 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-23T23:56:39.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-23T23:56:39.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-23T23:56:39.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-23T23:56:39.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-23T23:56:39.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.976+0000 7f3cb0800640 1 Processor -- start 2024-03-23T23:56:39.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.977+0000 7f3cb0800640 1 -- start start 2024-03-23T23:56:39.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.978+0000 7f3cb0800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4036b70 0x7f3ca4036510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.978+0000 7f3cb0800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3ca4036f50 0x7f3ca4033720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.978+0000 7f3cb0800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ca4033c60 0x7f3ca40c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.979+0000 7f3cade00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4036b70 0x7f3ca4036510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.979+0000 7f3cade00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4036b70 0x7f3ca4036510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:32816/0 (socket says 172.21.15.31:32816) 2024-03-23T23:56:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.979+0000 7f3cade00640 1 -- 172.21.15.31:0/2118849281 learned_addr learned my addr 172.21.15.31:0/2118849281 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.980+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca4035590 con 0x7f3ca4036f50 2024-03-23T23:56:39.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.980+0000 7f3cae800640 1 --2- 172.21.15.31:0/2118849281 >> v2:172.21.15.59:3300/0 conn(0x7f3ca4033c60 0x7f3ca40c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.980+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca4035e30 con 0x7f3ca4033c60 2024-03-23T23:56:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.980+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40362c0 con 0x7f3ca4036b70 2024-03-23T23:56:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.980+0000 7f3cad400640 1 --2- 172.21.15.31:0/2118849281 >> v2:172.21.15.31:3300/0 conn(0x7f3ca4036f50 0x7f3ca4033720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.981+0000 7f3cade00640 1 -- 172.21.15.31:0/2118849281 >> v2:172.21.15.59:3300/0 conn(0x7f3ca4033c60 msgr2=0x7f3ca40c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.981+0000 7f3cade00640 1 --2- 172.21.15.31:0/2118849281 >> v2:172.21.15.59:3300/0 conn(0x7f3ca4033c60 0x7f3ca40c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.981+0000 7f3cade00640 1 -- 172.21.15.31:0/2118849281 >> v2:172.21.15.31:3300/0 conn(0x7f3ca4036f50 msgr2=0x7f3ca4033720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:39.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.981+0000 7f3cade00640 1 --2- 172.21.15.31:0/2118849281 >> v2:172.21.15.31:3300/0 conn(0x7f3ca4036f50 0x7f3ca4033720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.982+0000 7f3cade00640 1 -- 172.21.15.31:0/2118849281 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4029f60 con 0x7f3ca4036b70 2024-03-23T23:56:39.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.983+0000 7f3cad400640 1 --2- 172.21.15.31:0/2118849281 >> v2:172.21.15.31:3300/0 conn(0x7f3ca4036f50 0x7f3ca4033720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:39.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.984+0000 7f3cade00640 1 --2- 172.21.15.31:0/2118849281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4036b70 0x7f3ca4036510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4039bc0 tx=0x7f3c9c02c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf3eb4605e88b36 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.985+0000 7f3caca00640 1 -- 172.21.15.31:0/2118849281 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c035020 con 0x7f3ca4036b70 2024-03-23T23:56:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.985+0000 7f3caca00640 1 -- 172.21.15.31:0/2118849281 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c008df0 con 0x7f3ca4036b70 2024-03-23T23:56:39.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.986+0000 7f3caca00640 1 -- 172.21.15.31:0/2118849281 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00a2d0 con 0x7f3ca4036b70 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.987+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4036b70 msgr2=0x7f3ca4036510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.987+0000 7f3cb0800640 1 --2- 172.21.15.31:0/2118849281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4036b70 0x7f3ca4036510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4039bc0 tx=0x7f3c9c02c980 comp rx=0 tx=0).stop 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.987+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 shutdown_connections 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.987+0000 7f3cb0800640 1 --2- 172.21.15.31:0/2118849281 >> v2:172.21.15.59:3300/0 conn(0x7f3ca4033c60 0x7f3ca40c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.987+0000 7f3cb0800640 1 --2- 172.21.15.31:0/2118849281 >> v2:172.21.15.31:3300/0 conn(0x7f3ca4036f50 0x7f3ca4033720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.988+0000 7f3cb0800640 1 --2- 172.21.15.31:0/2118849281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4036b70 0x7f3ca4036510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.988+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 >> 172.21.15.31:0/2118849281 conn(0x7f3ca403a8a0 msgr2=0x7f3ca403acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.988+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 shutdown_connections 2024-03-23T23:56:39.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.988+0000 7f3cb0800640 1 -- 172.21.15.31:0/2118849281 wait complete. 2024-03-23T23:56:39.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.992+0000 7f3cb0800640 1 Processor -- start 2024-03-23T23:56:39.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.992+0000 7f3cb0800640 1 -- start start 2024-03-23T23:56:39.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.994+0000 7f3cb0800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4033c60 0x7f3ca40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.995+0000 7f3cb0800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca4036b70 0x7f3ca415da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.995+0000 7f3cb0800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca4036f50 0x7f3ca4032c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:39.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.995+0000 7f3cad400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca4036b70 0x7f3ca415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.995+0000 7f3cade00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4033c60 0x7f3ca40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.996+0000 7f3cade00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4033c60 0x7f3ca40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:32820/0 (socket says 172.21.15.31:32820) 2024-03-23T23:56:39.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.996+0000 7f3cad400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca4036b70 0x7f3ca415da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32920/0 (socket says 172.21.15.31:32920) 2024-03-23T23:56:39.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.996+0000 7f3cade00640 1 -- 172.21.15.31:0/2976205170 learned_addr learned my addr 172.21.15.31:0/2976205170 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:39.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.996+0000 7f3cb0800640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca4035ac0 con 0x7f3ca4036b70 2024-03-23T23:56:39.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.996+0000 7f3cb0800640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca4029c80 con 0x7f3ca4036f50 2024-03-23T23:56:39.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.997+0000 7f3cb0800640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca4006ef0 con 0x7f3ca4033c60 2024-03-23T23:56:39.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.997+0000 7f3cae800640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca4036f50 0x7f3ca4032c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:39.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.997+0000 7f3cad400640 1 -- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4033c60 msgr2=0x7f3ca40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:39.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.998+0000 7f3cad400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4033c60 0x7f3ca40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.998+0000 7f3cad400640 1 -- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca4036f50 msgr2=0x7f3ca4032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:39.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.998+0000 7f3cad400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca4036f50 0x7f3ca4032c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:39.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.998+0000 7f3cad400640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca402b4d0 con 0x7f3ca4036b70 2024-03-23T23:56:39.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.998+0000 7f3cade00640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4033c60 0x7f3ca40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:39.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:39.999+0000 7f3cad400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca4036b70 0x7f3ca415da30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000b60 tx=0x7f3ca8073600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:39.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.000+0000 7f3ca2000640 1 -- 172.21.15.31:0/2976205170 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8097020 con 0x7f3ca4036b70 2024-03-23T23:56:40.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.000+0000 7f3cb0800640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca40c45b0 con 0x7f3ca4036b70 2024-03-23T23:56:40.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.000+0000 7f3cb0800640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca40c4b70 con 0x7f3ca4036b70 2024-03-23T23:56:40.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.000+0000 7f3ca2000640 1 -- 172.21.15.31:0/2976205170 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8093440 con 0x7f3ca4036b70 2024-03-23T23:56:40.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.000+0000 7f3ca2000640 1 -- 172.21.15.31:0/2976205170 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8097020 con 0x7f3ca4036b70 2024-03-23T23:56:40.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.007+0000 7f3ca2000640 1 -- 172.21.15.31:0/2976205170 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3ca809a020 con 0x7f3ca4036b70 2024-03-23T23:56:40.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.008+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c80005290 con 0x7f3ca4036b70 2024-03-23T23:56:40.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.014+0000 7f3ca2000640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c8c06bdd0 0x7f3c8c06e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.014+0000 7f3ca2000640 1 -- 172.21.15.31:0/2976205170 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ca8107b60 con 0x7f3ca4036b70 2024-03-23T23:56:40.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.014+0000 7f3cade00640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c8c06bdd0 0x7f3c8c06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.019+0000 7f3cade00640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c8c06bdd0 0x7f3c8c06e290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0071a0 tx=0x7f3c9c00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.020+0000 7f3ca2000640 1 -- 172.21.15.31:0/2976205170 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f3ca80a1030 con 0x7f3ca4036b70 2024-03-23T23:56:40.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.027+0000 7f0c02c00640 1 Processor -- start 2024-03-23T23:56:40.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.027+0000 7f0c02c00640 1 -- start start 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.028+0000 7f0c02c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0bfc0ade70 0x7f0bfc14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f0c02c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc0b8990 0x7f0bfc155df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f0c02c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc145cf0 con 0x7f0bfc14e600 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f0c02c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc14c9c0 con 0x7f0bfc0ade70 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f0c02c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc0ad9a0 con 0x7f0bfc0b8990 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f0c00c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc0b8990 0x7f0bfc155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f0c00c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc0b8990 0x7f0bfc155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:32828/0 (socket says 172.21.15.31:32828) 2024-03-23T23:56:40.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f0c00c00640 1 -- 172.21.15.31:0/607615973 learned_addr learned my addr 172.21.15.31:0/607615973 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.029+0000 7f6b20a00640 1 Processor -- start 2024-03-23T23:56:40.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.030+0000 7f6b20a00640 1 -- start start 2024-03-23T23:56:40.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.030+0000 7f0bfbe00640 1 --2- 172.21.15.31:0/607615973 >> v2:172.21.15.31:3300/0 conn(0x7f0bfc0ade70 0x7f0bfc14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.030+0000 7f0c00c00640 1 -- 172.21.15.31:0/607615973 >> v2:172.21.15.31:3300/0 conn(0x7f0bfc0ade70 msgr2=0x7f0bfc14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.030+0000 7f0c00c00640 1 --2- 172.21.15.31:0/607615973 >> v2:172.21.15.31:3300/0 conn(0x7f0bfc0ade70 0x7f0bfc14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.031+0000 7f0c00c00640 1 -- 172.21.15.31:0/607615973 >> v1:172.21.15.31:6789/0 conn(0x7f0bfc14e600 legacy=0x7f0bfc14bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.031+0000 7f0c00c00640 1 -- 172.21.15.31:0/607615973 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0af100 con 0x7f0bfc0b8990 2024-03-23T23:56:40.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.032+0000 7f6b20a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b1c0b5210 0x7f6b1c14a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.032+0000 7f6b20a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b1c0b6bc0 0x7f6b1c14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.032+0000 7f6b20a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c0b3e60 con 0x7f6b1c0b9850 2024-03-23T23:56:40.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.032+0000 7f6b20a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b55f0 con 0x7f6b1c0b5210 2024-03-23T23:56:40.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.032+0000 7f6b20a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b9dc0 con 0x7f6b1c0b6bc0 2024-03-23T23:56:40.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.032+0000 7f6b1b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b1c0b6bc0 0x7f6b1c14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.033+0000 7f6b1a800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b1c0b5210 0x7f6b1c14a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.032+0000 7f0bfbe00640 1 --2- 172.21.15.31:0/607615973 >> v2:172.21.15.31:3300/0 conn(0x7f0bfc0ade70 0x7f0bfc14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.033+0000 7f6b1a800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b1c0b5210 0x7f6b1c14a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32950/0 (socket says 172.21.15.31:32950) 2024-03-23T23:56:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.033+0000 7f6b1a800640 1 -- 172.21.15.31:0/1480837533 learned_addr learned my addr 172.21.15.31:0/1480837533 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.033+0000 7f6b1b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b1c0b6bc0 0x7f6b1c14ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45428/0 (socket says 172.21.15.31:45428) 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.033+0000 7f6b19e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b1c0b9850 0x7f6b1c0b73e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:48266/0 (socket says 172.21.15.31:48266) 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.034+0000 7f6b1a800640 1 -- 172.21.15.31:0/1480837533 >> v2:172.21.15.59:3300/0 conn(0x7f6b1c0b6bc0 msgr2=0x7f6b1c14ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.034+0000 7f6b1a800640 1 --2- 172.21.15.31:0/1480837533 >> v2:172.21.15.59:3300/0 conn(0x7f6b1c0b6bc0 0x7f6b1c14ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.034+0000 7f6b1a800640 1 -- 172.21.15.31:0/1480837533 >> v1:172.21.15.59:6789/0 conn(0x7f6b1c0b9850 legacy=0x7f6b1c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.034+0000 7f6b1a800640 1 -- 172.21.15.31:0/1480837533 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c0b4100 con 0x7f6b1c0b5210 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.036+0000 7f6b1a800640 1 --2- 172.21.15.31:0/1480837533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b5210 0x7f6b1c14a850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0b5a20 tx=0x7f6b0802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a411da729010e91 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.036+0000 7fa0e2400640 1 Processor -- start 2024-03-23T23:56:40.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.037+0000 7fa0e2400640 1 -- start start 2024-03-23T23:56:40.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.037+0000 7f0c00c00640 1 --2- 172.21.15.31:0/607615973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc0b8990 0x7f0bfc155df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009e50 tx=0x7f0bf402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcef5dfc9a4c7120 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.037+0000 7f6b19400640 1 -- 172.21.15.31:0/1480837533 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08034070 con 0x7f6b1c0b5210 2024-03-23T23:56:40.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.037+0000 7f0bfaa00640 1 -- 172.21.15.31:0/607615973 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf402ca80 con 0x7f0bfc0b8990 2024-03-23T23:56:40.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.037+0000 7f6b19400640 1 -- 172.21.15.31:0/1480837533 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08030870 con 0x7f6b1c0b5210 2024-03-23T23:56:40.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.037+0000 7f6b19400640 1 -- 172.21.15.31:0/1480837533 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08030c40 con 0x7f6b1c0b5210 2024-03-23T23:56:40.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.038+0000 7f0bfaa00640 1 -- 172.21.15.31:0/607615973 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf402cc20 con 0x7f0bfc0b8990 2024-03-23T23:56:40.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f6b20a00640 1 -- 172.21.15.31:0/1480837533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b5210 msgr2=0x7f6b1c14a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f6b20a00640 1 --2- 172.21.15.31:0/1480837533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b5210 0x7f6b1c14a850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0b5a20 tx=0x7f6b0802b9b0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.038+0000 7f0bfaa00640 1 -- 172.21.15.31:0/607615973 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf402ca80 con 0x7f0bfc0b8990 2024-03-23T23:56:40.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f6b20a00640 1 -- 172.21.15.31:0/1480837533 shutdown_connections 2024-03-23T23:56:40.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f6b20a00640 1 --2- 172.21.15.31:0/1480837533 >> v2:172.21.15.59:3300/0 conn(0x7f6b1c0b6bc0 0x7f6b1c14ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f6b20a00640 1 --2- 172.21.15.31:0/1480837533 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b5210 0x7f6b1c14a850 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f6b20a00640 1 -- 172.21.15.31:0/1480837533 >> 172.21.15.31:0/1480837533 conn(0x7f6b1c066fb0 msgr2=0x7f6b1c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f0c02c00640 1 -- 172.21.15.31:0/607615973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc0b8990 msgr2=0x7f0bfc155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.039+0000 7f0c02c00640 1 --2- 172.21.15.31:0/607615973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc0b8990 0x7f0bfc155df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009e50 tx=0x7f0bf402bee0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.040+0000 7f0c02c00640 1 -- 172.21.15.31:0/607615973 shutdown_connections 2024-03-23T23:56:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.040+0000 7f0c02c00640 1 --2- 172.21.15.31:0/607615973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc0b8990 0x7f0bfc155df0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.040+0000 7f0c02c00640 1 --2- 172.21.15.31:0/607615973 >> v2:172.21.15.31:3300/0 conn(0x7f0bfc0ade70 0x7f0bfc14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.040+0000 7f0c02c00640 1 -- 172.21.15.31:0/607615973 >> 172.21.15.31:0/607615973 conn(0x7f0bfc06b990 msgr2=0x7f0bfc06bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.040+0000 7f0c02c00640 1 -- 172.21.15.31:0/607615973 shutdown_connections 2024-03-23T23:56:40.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.040+0000 7f6b20a00640 1 -- 172.21.15.31:0/1480837533 shutdown_connections 2024-03-23T23:56:40.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.040+0000 7f6b20a00640 1 -- 172.21.15.31:0/1480837533 wait complete. 2024-03-23T23:56:40.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.041+0000 7fa0e2400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d40389a0 0x7fa0d40cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.041+0000 7fa0e2400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0d403a270 0x7fa0d403a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.041+0000 7fa0e2400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d403ac40 con 0x7fa0d403e0a0 2024-03-23T23:56:40.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.041+0000 7fa0e2400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40ccb60 con 0x7fa0d403a270 2024-03-23T23:56:40.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.041+0000 7fa0e2400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40cce40 con 0x7fa0d40389a0 2024-03-23T23:56:40.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.041+0000 7f0c02c00640 1 -- 172.21.15.31:0/607615973 wait complete. 2024-03-23T23:56:40.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.042+0000 7fa0db400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d40389a0 0x7fa0d40cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.042+0000 7fa0dbe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0d403a270 0x7fa0d403a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.042+0000 7fa0dbe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0d403a270 0x7fa0d403a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32962/0 (socket says 172.21.15.31:32962) 2024-03-23T23:56:40.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.042+0000 7fa0dbe00640 1 -- 172.21.15.31:0/3754203336 learned_addr learned my addr 172.21.15.31:0/3754203336 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.043+0000 7f0c02c00640 1 Processor -- start 2024-03-23T23:56:40.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.043+0000 7f0c02c00640 1 -- start start 2024-03-23T23:56:40.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.043+0000 7fa0db400640 1 -- 172.21.15.31:0/3754203336 >> v2:172.21.15.31:3300/0 conn(0x7fa0d403a270 msgr2=0x7fa0d403a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.043+0000 7fa0db400640 1 --2- 172.21.15.31:0/3754203336 >> v2:172.21.15.31:3300/0 conn(0x7fa0d403a270 0x7fa0d403a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.043+0000 7fa0db400640 1 -- 172.21.15.31:0/3754203336 >> v1:172.21.15.31:6789/0 conn(0x7fa0d403e0a0 legacy=0x7fa0d4039580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.043+0000 7fa0db400640 1 -- 172.21.15.31:0/3754203336 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40cd120 con 0x7fa0d40389a0 2024-03-23T23:56:40.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.043+0000 7f6b20a00640 1 Processor -- start 2024-03-23T23:56:40.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.044+0000 7f6b20a00640 1 -- start start 2024-03-23T23:56:40.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.045+0000 7f6b20a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c0b5210 0x7f6b1c1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.045+0000 7fa0db400640 1 --2- 172.21.15.31:0/3754203336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d40389a0 0x7fa0d40cc560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00097a0 tx=0x7fa0d002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e678c2826a9592d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.045+0000 7f6b20a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b6bc0 0x7f6b1c1490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.045+0000 7f0c02c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bfc0ade70 0x7f0bfc0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b20a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0b9850 0x7f6b1c1495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b20a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b7c70 con 0x7f6b1c0b6bc0 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b20a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b7af0 con 0x7f6b1c0b9850 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b19e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b6bc0 0x7f6b1c1490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b20a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b7df0 con 0x7f6b1c0b5210 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b19e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b6bc0 0x7f6b1c1490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32972/0 (socket says 172.21.15.31:32972) 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b19e00640 1 -- 172.21.15.31:0/4095000753 learned_addr learned my addr 172.21.15.31:0/4095000753 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f6b1a800640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c0b5210 0x7f6b1c1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.047+0000 7f6b1b200640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0b9850 0x7f6b1c1495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.047+0000 7fa0da000640 1 -- 172.21.15.31:0/3754203336 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0039070 con 0x7fa0d40389a0 2024-03-23T23:56:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.047+0000 7fa0da000640 1 -- 172.21.15.31:0/3754203336 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00316f0 con 0x7fa0d40389a0 2024-03-23T23:56:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.047+0000 7fa0da000640 1 -- 172.21.15.31:0/3754203336 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0031ac0 con 0x7fa0d40389a0 2024-03-23T23:56:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0c02c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bfc0b8990 0x7f0bfc147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0c02c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc14e600 0x7f0bfc141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0c02c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc14c390 con 0x7f0bfc0ade70 2024-03-23T23:56:40.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0c02c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc14b760 con 0x7f0bfc0b8990 2024-03-23T23:56:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0c02c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc14c510 con 0x7f0bfc14e600 2024-03-23T23:56:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0bfbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bfc0ade70 0x7f0bfc0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0bfbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bfc0ade70 0x7f0bfc0b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:32974/0 (socket says 172.21.15.31:32974) 2024-03-23T23:56:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.046+0000 7f0bfbe00640 1 -- 172.21.15.31:0/3255331118 learned_addr learned my addr 172.21.15.31:0/3255331118 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.047+0000 7f6b1a800640 1 -- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0b9850 msgr2=0x7f6b1c1495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.047+0000 7f6b1a800640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0b9850 0x7f6b1c1495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.047+0000 7f6b1a800640 1 -- 172.21.15.31:0/4095000753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b6bc0 msgr2=0x7f6b1c1490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f0bfbe00640 1 -- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc14e600 msgr2=0x7f0bfc141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7fa0e2400640 1 -- 172.21.15.31:0/3754203336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d40389a0 msgr2=0x7fa0d40cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7fa0e2400640 1 --2- 172.21.15.31:0/3754203336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d40389a0 0x7fa0d40cc560 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00097a0 tx=0x7fa0d002b790 comp rx=0 tx=0).stop 2024-03-23T23:56:40.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f0bfbe00640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc14e600 0x7f0bfc141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7fa0e2400640 1 -- 172.21.15.31:0/3754203336 shutdown_connections 2024-03-23T23:56:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f6b1a800640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b6bc0 0x7f6b1c1490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f0bfbe00640 1 -- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bfc0b8990 msgr2=0x7f0bfc147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f0bfbe00640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bfc0b8990 0x7f0bfc147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f6b1a800640 1 -- 172.21.15.31:0/4095000753 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c144500 con 0x7f6b1c0b5210 2024-03-23T23:56:40.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f6b19e00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b6bc0 0x7f6b1c1490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:56:40.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f0bfbe00640 1 -- 172.21.15.31:0/3255331118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0b3f50 con 0x7f0bfc0ade70 2024-03-23T23:56:40.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7f1812e00640 1 Processor -- start 2024-03-23T23:56:40.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7fa0e2400640 1 --2- 172.21.15.31:0/3754203336 >> v2:172.21.15.31:3300/0 conn(0x7fa0d403a270 0x7fa0d403a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7fa0e2400640 1 --2- 172.21.15.31:0/3754203336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d40389a0 0x7fa0d40cc560 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.048+0000 7fa0e2400640 1 -- 172.21.15.31:0/3754203336 >> 172.21.15.31:0/3754203336 conn(0x7fa0d403eab0 msgr2=0x7fa0d403eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.049+0000 7fa0e2400640 1 -- 172.21.15.31:0/3754203336 shutdown_connections 2024-03-23T23:56:40.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.049+0000 7f0bfbe00640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bfc0ade70 0x7f0bfc0b1d70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c7f0 tx=0x7f0bec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.049+0000 7f1812e00640 1 -- start start 2024-03-23T23:56:40.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.049+0000 7fa0e2400640 1 -- 172.21.15.31:0/3754203336 wait complete. 2024-03-23T23:56:40.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.051+0000 7f1812e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f180c0b1250 0x7f180c0723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.049+0000 7f6b1a800640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c0b5210 0x7f6b1c1431f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b08033000 tx=0x7f6b08004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.051+0000 7f1812e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c0b2b10 con 0x7f180c072910 2024-03-23T23:56:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.051+0000 7f1812e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c0b2270 con 0x7f180c0b5a70 2024-03-23T23:56:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.051+0000 7f1812e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c0b5e50 con 0x7f180c0b1250 2024-03-23T23:56:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.051+0000 7f6b12a00640 1 -- 172.21.15.31:0/4095000753 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08048070 con 0x7f6b1c0b5210 2024-03-23T23:56:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.051+0000 7f6b12a00640 1 -- 172.21.15.31:0/4095000753 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08030670 con 0x7f6b1c0b5210 2024-03-23T23:56:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f6b12a00640 1 -- 172.21.15.31:0/4095000753 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08034040 con 0x7f6b1c0b5210 2024-03-23T23:56:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f180be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f180c0b5a70 0x7f180c14eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:48272/0 (socket says 172.21.15.31:48272) 2024-03-23T23:56:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f180be00640 1 -- 172.21.15.31:0/632493470 learned_addr learned my addr 172.21.15.31:0/632493470 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7fa0e2400640 1 Processor -- start 2024-03-23T23:56:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c143890 con 0x7f6b1c0b5210 2024-03-23T23:56:40.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314559665 0 0) 0x7f1804001110 con 0x7f180c0b5a70 2024-03-23T23:56:40.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f0003520 con 0x7f180c0b5a70 2024-03-23T23:56:40.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c143d60 con 0x7f6b1c0b5210 2024-03-23T23:56:40.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f180b400640 1 --2- 172.21.15.31:0/632493470 >> v2:172.21.15.31:3300/0 conn(0x7f180c0b1250 0x7f180c0723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f0bf3e00640 1 -- 172.21.15.31:0/3255331118 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec015070 con 0x7f0bfc0ade70 2024-03-23T23:56:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f0bf3e00640 1 -- 172.21.15.31:0/3255331118 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec007a30 con 0x7f0bfc0ade70 2024-03-23T23:56:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7f0bf3e00640 1 -- 172.21.15.31:0/3255331118 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec007e00 con 0x7f0bfc0ade70 2024-03-23T23:56:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f0c02c00640 1 -- 172.21.15.31:0/3255331118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc0b41c0 con 0x7f0bfc0ade70 2024-03-23T23:56:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f0c02c00640 1 -- 172.21.15.31:0/3255331118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc1482d0 con 0x7f0bfc0ade70 2024-03-23T23:56:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.052+0000 7fa0e2400640 1 -- start start 2024-03-23T23:56:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 <== mon.1 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1511112695 0 0) 0x7f17f0003520 con 0x7f180c0b5a70 2024-03-23T23:56:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 >> v2:172.21.15.31:3300/0 conn(0x7f180c0b1250 msgr2=0x7f180c0723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f180aa00640 1 --2- 172.21.15.31:0/632493470 >> v2:172.21.15.31:3300/0 conn(0x7f180c0b1250 0x7f180c0723d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 >> v1:172.21.15.31:6789/0 conn(0x7f180c072910 legacy=0x7f180c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.053+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0b2550 con 0x7f180c0b5a70 2024-03-23T23:56:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.054+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 <== mon.1 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f1804001840 con 0x7f180c0b5a70 2024-03-23T23:56:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.054+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 >> v1:172.21.15.59:6789/0 conn(0x7f180c0b5a70 legacy=0x7f180c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.054+0000 7f180aa00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f00039b0 0x7f17f0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.054+0000 7f180aa00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f0004800 0x7f17f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.055+0000 7f180aa00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17f00051c0 0x7f17f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.055+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0b5e50 con 0x7f17f00051c0 2024-03-23T23:56:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.055+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f000c0f0 con 0x7f17f0004800 2024-03-23T23:56:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.055+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f000c2f0 con 0x7f17f00039b0 2024-03-23T23:56:40.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.055+0000 7fa0e2400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d403a270 0x7fa0d40c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.055+0000 7fa0e2400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d4152760 0x7fa0d4165770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.055+0000 7fa0e2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d4165cb0 0x7fa0d4157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.056+0000 7fa0db400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d403a270 0x7fa0d40c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.056+0000 7fa0dbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d4165cb0 0x7fa0d4157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.056+0000 7f180be00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f00039b0 0x7f17f0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.056+0000 7f180b400640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f0004800 0x7f17f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.056+0000 7f1810e00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17f00051c0 0x7f17f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.056+0000 7fa0dbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d4165cb0 0x7fa0d4157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45462/0 (socket says 172.21.15.31:45462) 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.056+0000 7fa0dbe00640 1 -- 172.21.15.31:0/1563143400 learned_addr learned my addr 172.21.15.31:0/1563143400 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4039c90 con 0x7fa0d4152760 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d403b350 con 0x7fa0d4165cb0 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d4039e10 con 0x7fa0d403a270 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0daa00640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d4152760 0x7fa0d4165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7f1810e00640 1 -- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f00039b0 msgr2=0x7f17f0003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7f1810e00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17f00039b0 0x7f17f0003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7f1810e00640 1 -- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f0004800 msgr2=0x7f17f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7f1810e00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f0004800 0x7f17f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7f1810e00640 1 -- 172.21.15.31:0/632493470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f0003520 con 0x7f17f00051c0 2024-03-23T23:56:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd0005290 con 0x7f0bfc0ade70 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0daa00640 1 -- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d403a270 msgr2=0x7fa0d40c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0daa00640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d403a270 0x7fa0d40c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0daa00640 1 -- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d4165cb0 msgr2=0x7fa0d4157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0daa00640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d4165cb0 0x7fa0d4157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.057+0000 7fa0daa00640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4154820 con 0x7fa0d4152760 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.058+0000 7fa0daa00640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d4152760 0x7fa0d4165770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc050670 tx=0x7fa0dc0692b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f1810e00640 1 -- 172.21.15.31:0/632493470 reap_dead start 2024-03-23T23:56:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f1810e00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17f00051c0 0x7f17f000b9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17fc004480 tx=0x7f17f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b1cc0140cc2207 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.058+0000 7f6b12a00640 1 -- 172.21.15.31:0/4095000753 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6b08037070 con 0x7f6b1c0b5210 2024-03-23T23:56:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af4005290 con 0x7f6b1c0b5210 2024-03-23T23:56:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f6b12a00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f6afc06bbd0 0x7f6afc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f6b12a00640 1 -- 172.21.15.31:0/4095000753 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b080ac600 con 0x7f6b1c0b5210 2024-03-23T23:56:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.060+0000 7f6b19e00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f6afc06bbd0 0x7f6afc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f0bf3e00640 1 -- 172.21.15.31:0/3255331118 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0bec018070 con 0x7f0bfc0ade70 2024-03-23T23:56:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7fa0cf400640 1 -- 172.21.15.31:0/1563143400 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc06f070 con 0x7fa0d4152760 2024-03-23T23:56:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc034070 con 0x7f17f00051c0 2024-03-23T23:56:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7f5d54600640 1 Processor -- start 2024-03-23T23:56:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.060+0000 7f5d54600640 1 -- start start 2024-03-23T23:56:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7fa0cf400640 1 -- 172.21.15.31:0/1563143400 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0693e0 con 0x7fa0d4152760 2024-03-23T23:56:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.059+0000 7fa0cf400640 1 -- 172.21.15.31:0/1563143400 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc073510 con 0x7fa0d4152760 2024-03-23T23:56:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.060+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d4152f00 con 0x7fa0d4152760 2024-03-23T23:56:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.060+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d41534c0 con 0x7fa0d4152760 2024-03-23T23:56:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.061+0000 7f5d54600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5d4c1449e0 0x7f5d4c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.060+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc006b50 con 0x7f17f00051c0 2024-03-23T23:56:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.060+0000 7f180aa00640 1 -- 172.21.15.31:0/632493470 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc034070 con 0x7f17f00051c0 2024-03-23T23:56:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.061+0000 7f1812e00640 1 -- 172.21.15.31:0/632493470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17f00051c0 msgr2=0x7f17f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.061+0000 7f1812e00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17f00051c0 0x7f17f000b9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f17fc004480 tx=0x7f17f0005830 comp rx=0 tx=0).stop 2024-03-23T23:56:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.062+0000 7f1812e00640 1 -- 172.21.15.31:0/632493470 shutdown_connections 2024-03-23T23:56:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.062+0000 7f1812e00640 1 --2- 172.21.15.31:0/632493470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17f00051c0 0x7f17f000b9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.062+0000 7f5d51c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5d4c0b23d0 0x7f5d4c1411b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:48288/0 (socket says 172.21.15.31:48288) 2024-03-23T23:56:40.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.062+0000 7f1812e00640 1 -- 172.21.15.31:0/632493470 >> 172.21.15.31:0/632493470 conn(0x7f180c066fb0 msgr2=0x7f180c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.062+0000 7f1812e00640 1 -- 172.21.15.31:0/632493470 shutdown_connections 2024-03-23T23:56:40.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.062+0000 7f5d51200640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5d4c0b5a70 0x7f5d4c1442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59546/0 (socket says 172.21.15.31:59546) 2024-03-23T23:56:40.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.062+0000 7f1812e00640 1 -- 172.21.15.31:0/632493470 wait complete. 2024-03-23T23:56:40.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.063+0000 7f0bf3e00640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0bdc06bc20 0x7f0bdc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.063+0000 7f0bf3e00640 1 -- 172.21.15.31:0/3255331118 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bec08a9b0 con 0x7f0bfc0ade70 2024-03-23T23:56:40.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.064+0000 7f0bfb400640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0bdc06bc20 0x7f0bdc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.063+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d41536c0 con 0x7fa0d4152760 2024-03-23T23:56:40.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.064+0000 7f1812e00640 1 Processor -- start 2024-03-23T23:56:40.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.063+0000 7f5d54600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c06f090 con 0x7f5d4c0b5a70 2024-03-23T23:56:40.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.063+0000 7f5d51c00640 1 -- 172.21.15.31:0/3587009005 learned_addr learned my addr 172.21.15.31:0/3587009005 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:40.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.063+0000 7f5d54600640 1 -- 172.21.15.31:0/3587009005 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c06f370 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.064+0000 7f1812e00640 1 -- start start 2024-03-23T23:56:40.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.063+0000 7f5d54600640 1 -- 172.21.15.31:0/3587009005 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b4cf0 con 0x7f5d4c1449e0 2024-03-23T23:56:40.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.064+0000 7f5d52600640 1 --2- 172.21.15.31:0/3587009005 >> v2:172.21.15.31:3300/0 conn(0x7f5d4c1449e0 0x7f5d4c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.064+0000 7f5d4be00640 1 -- 172.21.15.31:0/3587009005 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797900550 0 0) 0x7f5d4c06f370 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.064+0000 7f5d4be00640 1 -- 172.21.15.31:0/3587009005 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003520 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.065+0000 7f0409a00640 1 Processor -- start 2024-03-23T23:56:40.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.065+0000 7f6b19e00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f6afc06bbd0 0x7f6afc06e090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c146b10 tx=0x7f6b0c007f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.065+0000 7f3397200640 1 Processor -- start 2024-03-23T23:56:40.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.065+0000 7f0409a00640 1 -- start start 2024-03-23T23:56:40.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.065+0000 7f3397200640 1 -- start start 2024-03-23T23:56:40.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.065+0000 7f1812e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f00051c0 0x7f180c13f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f1812e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f180c140c50 0x7f180c141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f1812e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f180c142220 0x7f180c13e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.065+0000 7f5d4be00640 1 -- 172.21.15.31:0/3587009005 <== mon.1 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2515335693 0 0) 0x7f5d34003520 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f5d52600640 1 -- 172.21.15.31:0/3587009005 >> v1:172.21.15.59:6789/0 conn(0x7f5d4c0b23d0 legacy=0x7f5d4c1411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f5d52600640 1 -- 172.21.15.31:0/3587009005 >> v1:172.21.15.31:6789/0 conn(0x7f5d4c0b5a70 legacy=0x7f5d4c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f5d52600640 1 -- 172.21.15.31:0/3587009005 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0b4fd0 con 0x7f5d4c1449e0 2024-03-23T23:56:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f1812e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0affc0 con 0x7f180c142220 2024-03-23T23:56:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f180be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f00051c0 0x7f180c13f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f180be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f00051c0 0x7f180c13f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45468/0 (socket says 172.21.15.31:45468) 2024-03-23T23:56:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f180be00640 1 -- 172.21.15.31:0/4024268489 learned_addr learned my addr 172.21.15.31:0/4024268489 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f1810e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f180c142220 0x7f180c13e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f3397200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33900b5780 0x7f3390146e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f3397200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3390143860 0x7f3390143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f3397200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33901433a0 con 0x7f33900b5b60 2024-03-23T23:56:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f3397200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3390144250 con 0x7f33900b5780 2024-03-23T23:56:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f3397200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900b2770 con 0x7f3390143860 2024-03-23T23:56:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f180b400640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f180c140c50 0x7f180c141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f338fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33900b5780 0x7f3390146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f338fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33900b5780 0x7f3390146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33014/0 (socket says 172.21.15.31:33014) 2024-03-23T23:56:40.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f338fe00640 1 -- 172.21.15.31:0/1890730410 learned_addr learned my addr 172.21.15.31:0/1890730410 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0b1ef0 con 0x7f17f00051c0 2024-03-23T23:56:40.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0b0140 con 0x7f180c140c50 2024-03-23T23:56:40.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.066+0000 7f0bfb400640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0bdc06bc20 0x7f0bdc06e0e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000f60 tx=0x7f0be80079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f3395200640 1 --2- 172.21.15.31:0/1890730410 >> v2:172.21.15.59:3300/0 conn(0x7f3390143860 0x7f3390143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f338fe00640 1 -- 172.21.15.31:0/1890730410 >> v2:172.21.15.59:3300/0 conn(0x7f3390143860 msgr2=0x7f3390143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f338fe00640 1 --2- 172.21.15.31:0/1890730410 >> v2:172.21.15.59:3300/0 conn(0x7f3390143860 0x7f3390143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f338fe00640 1 -- 172.21.15.31:0/1890730410 >> v1:172.21.15.59:6789/0 conn(0x7f33900b5b60 legacy=0x7f3390072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.067+0000 7f338fe00640 1 -- 172.21.15.31:0/1890730410 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390147450 con 0x7f33900b5780 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f1810e00640 1 -- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f180c140c50 msgr2=0x7f180c141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f1810e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f180c140c50 0x7f180c141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f1810e00640 1 -- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f00051c0 msgr2=0x7f180c13f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f1810e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f00051c0 0x7f180c13f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f1810e00640 1 -- 172.21.15.31:0/4024268489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c141330 con 0x7f180c142220 2024-03-23T23:56:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0409a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04040b5780 0x7f0404146e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0409a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0404143860 0x7f0404143d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0409a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04041433a0 con 0x7f04040b5b60 2024-03-23T23:56:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0402a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04040b5780 0x7f0404146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0409a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0404144250 con 0x7f04040b5780 2024-03-23T23:56:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0409a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04040b2770 con 0x7f0404143860 2024-03-23T23:56:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0402a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04040b5780 0x7f0404146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33028/0 (socket says 172.21.15.31:33028) 2024-03-23T23:56:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.068+0000 7f0402a00640 1 -- 172.21.15.31:0/3798250537 learned_addr learned my addr 172.21.15.31:0/3798250537 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f338fe00640 1 --2- 172.21.15.31:0/1890730410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33900b5780 0x7f3390146e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33900b2110 tx=0x7f338002da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c8285b70859290 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f5d52600640 1 --2- 172.21.15.31:0/3587009005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c1449e0 0x7f5d4c150ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009720 tx=0x7f5d3802b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ee924857d3c5be server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f0403400640 1 --2- 172.21.15.31:0/3798250537 >> v2:172.21.15.59:3300/0 conn(0x7f0404143860 0x7f0404143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f1810e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f180c142220 0x7f180c13e6f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f180c0b4a70 tx=0x7f17fc003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f0402a00640 1 -- 172.21.15.31:0/3798250537 >> v2:172.21.15.59:3300/0 conn(0x7f0404143860 msgr2=0x7f0404143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f0402a00640 1 --2- 172.21.15.31:0/3798250537 >> v2:172.21.15.59:3300/0 conn(0x7f0404143860 0x7f0404143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f0402a00640 1 -- 172.21.15.31:0/3798250537 >> v1:172.21.15.31:6789/0 conn(0x7f04040b5b60 legacy=0x7f0404072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.069+0000 7f0402a00640 1 -- 172.21.15.31:0/3798250537 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0404147450 con 0x7f04040b5780 2024-03-23T23:56:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.070+0000 7f0bf3e00640 1 -- 172.21.15.31:0/3255331118 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f0bec059510 con 0x7f0bfc0ade70 2024-03-23T23:56:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.070+0000 7f1803e00640 1 -- 172.21.15.31:0/4024268489 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc046070 con 0x7f180c142220 2024-03-23T23:56:40.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f5d4be00640 1 -- 172.21.15.31:0/3587009005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38037070 con 0x7f5d4c1449e0 2024-03-23T23:56:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f5d4be00640 1 -- 172.21.15.31:0/3587009005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38030510 con 0x7f5d4c1449e0 2024-03-23T23:56:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f5d4be00640 1 -- 172.21.15.31:0/3587009005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d440019d0 con 0x7f5d4c1449e0 2024-03-23T23:56:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f1803e00640 1 -- 172.21.15.31:0/4024268489 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc041410 con 0x7f180c142220 2024-03-23T23:56:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f1803e00640 1 -- 172.21.15.31:0/4024268489 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc034040 con 0x7f180c142220 2024-03-23T23:56:40.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f0402a00640 1 --2- 172.21.15.31:0/3798250537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f0404146e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04040b2110 tx=0x7f03fc0302f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f131db2c3bb9d75 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f5d54600640 1 -- 172.21.15.31:0/3587009005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c1449e0 msgr2=0x7f5d4c150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f5d54600640 1 --2- 172.21.15.31:0/3587009005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c1449e0 0x7f5d4c150ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009720 tx=0x7f5d3802b6a0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c141610 con 0x7f180c142220 2024-03-23T23:56:40.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.071+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c14be30 con 0x7f180c142220 2024-03-23T23:56:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f5d54600640 1 -- 172.21.15.31:0/3587009005 shutdown_connections 2024-03-23T23:56:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f5d54600640 1 --2- 172.21.15.31:0/3587009005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c1449e0 0x7f5d4c150ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f5d54600640 1 -- 172.21.15.31:0/3587009005 >> 172.21.15.31:0/3587009005 conn(0x7f5d4c066fb0 msgr2=0x7f5d4c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f5d54600640 1 -- 172.21.15.31:0/3587009005 shutdown_connections 2024-03-23T23:56:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f5d54600640 1 -- 172.21.15.31:0/3587009005 wait complete. 2024-03-23T23:56:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.072+0000 7f338ea00640 1 -- 172.21.15.31:0/1890730410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338002f850 con 0x7f33900b5780 2024-03-23T23:56:40.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.073+0000 7f338ea00640 1 -- 172.21.15.31:0/1890730410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338002f9f0 con 0x7f33900b5780 2024-03-23T23:56:40.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.073+0000 7f338ea00640 1 -- 172.21.15.31:0/1890730410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338002fdc0 con 0x7f33900b5780 2024-03-23T23:56:40.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.073+0000 7fa0cf400640 1 -- 172.21.15.31:0/1563143400 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa0dc071700 con 0x7fa0d4152760 2024-03-23T23:56:40.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.073+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c04f400 con 0x7f180c142220 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7f3397200640 1 -- 172.21.15.31:0/1890730410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33900b5780 msgr2=0x7f3390146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7f3397200640 1 --2- 172.21.15.31:0/1890730410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33900b5780 0x7f3390146e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f33900b2110 tx=0x7f338002da90 comp rx=0 tx=0).stop 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7f3397200640 1 -- 172.21.15.31:0/1890730410 shutdown_connections 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7f3397200640 1 --2- 172.21.15.31:0/1890730410 >> v2:172.21.15.59:3300/0 conn(0x7f3390143860 0x7f3390143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7f3397200640 1 --2- 172.21.15.31:0/1890730410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33900b5780 0x7f3390146e50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7f3397200640 1 -- 172.21.15.31:0/1890730410 >> 172.21.15.31:0/1890730410 conn(0x7f3390066dd0 msgr2=0x7f33900671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7f3397200640 1 -- 172.21.15.31:0/1890730410 shutdown_connections 2024-03-23T23:56:40.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7fa0cf400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fa0bc06bcd0 0x7fa0bc06e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.074+0000 7fa0cf400640 1 -- 172.21.15.31:0/1563143400 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0dc105830 con 0x7fa0d4152760 2024-03-23T23:56:40.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.075+0000 7f3397200640 1 -- 172.21.15.31:0/1890730410 wait complete. 2024-03-23T23:56:40.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.075+0000 7fa0db400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fa0bc06bcd0 0x7fa0bc06e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.075+0000 7f5d54600640 1 Processor -- start 2024-03-23T23:56:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.075+0000 7f5d54600640 1 -- start start 2024-03-23T23:56:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.076+0000 7fa0db400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fa0bc06bcd0 0x7fa0bc06e190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0036000 tx=0x7fa0d0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.076+0000 7f3397200640 1 Processor -- start 2024-03-23T23:56:40.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.076+0000 7f5d54600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d4c0b23d0 0x7f5d4c071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d54600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c0b5a70 0x7f5d4c0705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f3397200640 1 -- start start 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d51200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c0b5a70 0x7f5d4c0705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d51200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c0b5a70 0x7f5d4c0705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33040/0 (socket says 172.21.15.31:33040) 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d51c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d4c0b23d0 0x7f5d4c071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d51200640 1 -- 172.21.15.31:0/3592084284 learned_addr learned my addr 172.21.15.31:0/3592084284 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d54600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d4c1449e0 0x7f5d4c070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b2ea0 con 0x7f5d4c0b5a70 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b2d20 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c1418c0 con 0x7f5d4c1449e0 2024-03-23T23:56:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.077+0000 7f3397200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33900b5780 0x7f3390146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3397200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33900b5b60 0x7f33901dc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3397200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3390143860 0x7f33901d2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3397200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900b4d50 con 0x7f3390143860 2024-03-23T23:56:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3397200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900af950 con 0x7f33900b5b60 2024-03-23T23:56:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3397200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900678f0 con 0x7f33900b5780 2024-03-23T23:56:40.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f5d52600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d4c1449e0 0x7f5d4c070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3395200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3390143860 0x7f33901d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3395200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3390143860 0x7f33901d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33050/0 (socket says 172.21.15.31:33050) 2024-03-23T23:56:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.078+0000 7f3395200640 1 -- 172.21.15.31:0/211237974 learned_addr learned my addr 172.21.15.31:0/211237974 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f3395200640 1 -- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33900b5780 msgr2=0x7f3390146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f3395200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33900b5780 0x7f3390146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f3395200640 1 -- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33900b5b60 msgr2=0x7f33901dc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f338f400640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33900b5b60 0x7f33901dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f5d51c00640 1 -- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d4c1449e0 msgr2=0x7f5d4c070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f5d51c00640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d4c1449e0 0x7f5d4c070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f5d51c00640 1 -- 172.21.15.31:0/3592084284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c0b5a70 msgr2=0x7f5d4c0705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f5d51c00640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c0b5a70 0x7f5d4c0705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f5d51c00640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c145180 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f3395200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33900b5b60 0x7f33901dc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f3395200640 1 -- 172.21.15.31:0/211237974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33901dca60 con 0x7f3390143860 2024-03-23T23:56:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f338f400640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33900b5b60 0x7f33901dc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.079+0000 7f3395200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3390143860 0x7f33901d2830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3388007e60 tx=0x7f338800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f5d51c00640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d4c0b23d0 0x7f5d4c071d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d440016e0 tx=0x7f5d4400cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f3387e00640 1 -- 172.21.15.31:0/211237974 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388014420 con 0x7f3390143860 2024-03-23T23:56:40.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33901dcd40 con 0x7f3390143860 2024-03-23T23:56:40.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f0401600640 1 -- 172.21.15.31:0/3798250537 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00d2d0 con 0x7f04040b5780 2024-03-23T23:56:40.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7fa0cf400640 1 -- 172.21.15.31:0/1563143400 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fa0d41536c0 con 0x7fa0d4152760 2024-03-23T23:56:40.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f5d49600640 1 -- 172.21.15.31:0/3592084284 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44018070 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f5d49600640 1 -- 172.21.15.31:0/3592084284 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4400a640 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f5d49600640 1 -- 172.21.15.31:0/3592084284 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4400aa10 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c1e1450 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.081+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3390144560 con 0x7f3390143860 2024-03-23T23:56:40.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.080+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c06fa20 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.082+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c04f400 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.082+0000 7f0401600640 1 -- 172.21.15.31:0/3798250537 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc00d470 con 0x7f04040b5780 2024-03-23T23:56:40.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.083+0000 7f0409a00640 1 -- 172.21.15.31:0/3798250537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 msgr2=0x7f0404146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.083+0000 7f0409a00640 1 --2- 172.21.15.31:0/3798250537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f0404146e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f04040b2110 tx=0x7f03fc0302f0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.084+0000 7f0409a00640 1 -- 172.21.15.31:0/3798250537 shutdown_connections 2024-03-23T23:56:40.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.084+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339004f400 con 0x7f3390143860 2024-03-23T23:56:40.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.084+0000 7f0409a00640 1 --2- 172.21.15.31:0/3798250537 >> v2:172.21.15.59:3300/0 conn(0x7f0404143860 0x7f0404143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.084+0000 7f0409a00640 1 --2- 172.21.15.31:0/3798250537 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f0404146e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.084+0000 7f0409a00640 1 -- 172.21.15.31:0/3798250537 >> 172.21.15.31:0/3798250537 conn(0x7f0404066dd0 msgr2=0x7f04040671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.084+0000 7f3387e00640 1 -- 172.21.15.31:0/211237974 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388019070 con 0x7f3390143860 2024-03-23T23:56:40.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.085+0000 7f5d49600640 1 -- 172.21.15.31:0/3592084284 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5d4400abb0 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.086+0000 7f1803e00640 1 -- 172.21.15.31:0/4024268489 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f17fc038400 con 0x7f180c142220 2024-03-23T23:56:40.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.086+0000 7f3387e00640 1 -- 172.21.15.31:0/211237974 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880147c0 con 0x7f3390143860 2024-03-23T23:56:40.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.086+0000 7f6b12a00640 1 -- 172.21.15.31:0/4095000753 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f6b0807abb0 con 0x7f6b1c0b5210 2024-03-23T23:56:40.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.087+0000 7f1803e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f17e806bc00 0x7f17e806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.087+0000 7f1803e00640 1 -- 172.21.15.31:0/4024268489 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17fc0ac210 con 0x7f180c142220 2024-03-23T23:56:40.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.088+0000 7f180be00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f17e806bc00 0x7f17e806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.086+0000 7f0409a00640 1 -- 172.21.15.31:0/3798250537 shutdown_connections 2024-03-23T23:56:40.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.088+0000 7f0409a00640 1 -- 172.21.15.31:0/3798250537 wait complete. 2024-03-23T23:56:40.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.088+0000 7f3387e00640 1 -- 172.21.15.31:0/211237974 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3388014960 con 0x7f3390143860 2024-03-23T23:56:40.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.090+0000 7f3387e00640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f337006bdd0 0x7f337006e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.090+0000 7f0409a00640 1 Processor -- start 2024-03-23T23:56:40.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.090+0000 7f5d49600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5d2c06bc00 0x7f5d2c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.090+0000 7f5d49600640 1 -- 172.21.15.31:0/3592084284 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d4408a330 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.090+0000 7f0409a00640 1 -- start start 2024-03-23T23:56:40.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.091+0000 7f5d51200640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5d2c06bc00 0x7f5d2c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f180be00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f17e806bc00 0x7f17e806e0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f180c145190 tx=0x7f1804007aa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f338fe00640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f337006bdd0 0x7f337006e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f0409a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f040413aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f0409a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04040b5b60 0x7f0404138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f0409a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0404143860 0x7f0404138fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f0409a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04040b4d50 con 0x7f04040b5780 2024-03-23T23:56:40.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f0409a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04040af950 con 0x7f04040b5b60 2024-03-23T23:56:40.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f0409a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04040678f0 con 0x7f0404143860 2024-03-23T23:56:40.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.092+0000 7f0402a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f040413aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f040413aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33052/0 (socket says 172.21.15.31:33052) 2024-03-23T23:56:40.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402a00640 1 -- 172.21.15.31:0/437166226 learned_addr learned my addr 172.21.15.31:0/437166226 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0403400640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0404143860 0x7f0404138fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402000640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04040b5b60 0x7f0404138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f338fe00640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f337006bdd0 0x7f337006e290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3380038000 tx=0x7f3380032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402a00640 1 -- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0404143860 msgr2=0x7f0404138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0404143860 0x7f0404138fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402a00640 1 -- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04040b5b60 msgr2=0x7f0404138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04040b5b60 0x7f0404138a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0402a00640 1 -- 172.21.15.31:0/437166226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0404140680 con 0x7f04040b5780 2024-03-23T23:56:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.093+0000 7f0403400640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0404143860 0x7f0404138fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.094+0000 7f3387e00640 1 -- 172.21.15.31:0/211237974 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33880145c0 con 0x7f3390143860 2024-03-23T23:56:40.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.094+0000 7f5d51200640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5d2c06bc00 0x7f5d2c06e0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c071870 tx=0x7f5d40007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.095+0000 7f1803e00640 1 -- 172.21.15.31:0/4024268489 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f17fc07a840 con 0x7f180c142220 2024-03-23T23:56:40.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.095+0000 7f0402a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f040413aa10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00f3a0 tx=0x7f03fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.100+0000 7f5d49600640 1 -- 172.21.15.31:0/3592084284 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f5d44058860 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.103+0000 7f03faa00640 1 -- 172.21.15.31:0/437166226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc047070 con 0x7f04040b5780 2024-03-23T23:56:40.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.103+0000 7f03faa00640 1 -- 172.21.15.31:0/437166226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc00d620 con 0x7f04040b5780 2024-03-23T23:56:40.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.103+0000 7f03faa00640 1 -- 172.21.15.31:0/437166226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00d2d0 con 0x7f04040b5780 2024-03-23T23:56:40.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.103+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040406ff90 con 0x7f04040b5780 2024-03-23T23:56:40.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.103+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040413b0d0 con 0x7f04040b5780 2024-03-23T23:56:40.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.104+0000 7f3387e00640 1 -- 172.21.15.31:0/211237974 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f338805aa30 con 0x7f3390143860 2024-03-23T23:56:40.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.105+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040404f400 con 0x7f04040b5780 2024-03-23T23:56:40.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.107+0000 7f03faa00640 1 -- 172.21.15.31:0/437166226 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f03fc04a070 con 0x7f04040b5780 2024-03-23T23:56:40.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.108+0000 7f03faa00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f03e406bc50 0x7f03e406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.108+0000 7f03faa00640 1 -- 172.21.15.31:0/437166226 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03fc0acf00 con 0x7f04040b5780 2024-03-23T23:56:40.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.109+0000 7f0402000640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f03e406bc50 0x7f03e406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.113 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.110+0000 7f0402000640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f03e406bc50 0x7f03e406e110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f040413b460 tx=0x7f03f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.119+0000 7f03faa00640 1 -- 172.21.15.31:0/437166226 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f03fc07ba60 con 0x7f04040b5780 2024-03-23T23:56:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.456+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3c80005580 con 0x7f3ca4036b70 2024-03-23T23:56:40.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.457+0000 7f3ca2000640 1 -- 172.21.15.31:0/2976205170 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ca8072040 con 0x7f3ca4036b70 2024-03-23T23:56:40.460 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2024-03-23T23:56:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.461+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c8c06bdd0 msgr2=0x7f3c8c06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.461+0000 7f3c97400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c8c06bdd0 0x7f3c8c06e290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0071a0 tx=0x7f3c9c00a000 comp rx=0 tx=0).stop 2024-03-23T23:56:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.461+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca4036b70 msgr2=0x7f3ca415da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.461+0000 7f3c97400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca4036b70 0x7f3ca415da30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8000b60 tx=0x7f3ca8073600 comp rx=0 tx=0).stop 2024-03-23T23:56:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.462+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 shutdown_connections 2024-03-23T23:56:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.462+0000 7f3c97400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c8c06bdd0 0x7f3c8c06e290 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.462+0000 7f3c97400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca4036f50 0x7f3ca4032c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.462+0000 7f3c97400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ca4036b70 0x7f3ca415da30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.462+0000 7f3c97400640 1 --2- 172.21.15.31:0/2976205170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ca4033c60 0x7f3ca40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.462+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 >> 172.21.15.31:0/2976205170 conn(0x7f3ca403a8a0 msgr2=0x7f3ca40c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.463+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 shutdown_connections 2024-03-23T23:56:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.463+0000 7f3c97400640 1 -- 172.21.15.31:0/2976205170 wait complete. 2024-03-23T23:56:40.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.0 2024-03-23T23:56:40.491 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.498+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0bd0005580 con 0x7f0bfc0ade70 2024-03-23T23:56:40.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.499+0000 7f0bf3e00640 1 -- 172.21.15.31:0/3255331118 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0bec058e10 con 0x7f0bfc0ade70 2024-03-23T23:56:40.499 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2024-03-23T23:56:40.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.502+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0bdc06bc20 msgr2=0x7f0bdc06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0bdc06bc20 0x7f0bdc06e0e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000f60 tx=0x7f0be80079b0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bfc0ade70 msgr2=0x7f0bfc0b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bfc0ade70 0x7f0bfc0b1d70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0bec00c7f0 tx=0x7f0bec00cbf0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 shutdown_connections 2024-03-23T23:56:40.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0bdc06bc20 0x7f0bdc06e0e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bfc0b8990 0x7f0bfc147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bfc14e600 0x7f0bfc141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 --2- 172.21.15.31:0/3255331118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0bfc0ade70 0x7f0bfc0b1d70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.503+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 >> 172.21.15.31:0/3255331118 conn(0x7f0bfc06b990 msgr2=0x7f0bfc068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.504+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 shutdown_connections 2024-03-23T23:56:40.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.504+0000 7f0bf1600640 1 -- 172.21.15.31:0/3255331118 wait complete. 2024-03-23T23:56:40.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.508+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6af4005580 con 0x7f6b1c0b5210 2024-03-23T23:56:40.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.509+0000 7f6b12a00640 1 -- 172.21.15.31:0/4095000753 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b0807ec50 con 0x7f6b1c0b5210 2024-03-23T23:56:40.509 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2024-03-23T23:56:40.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f6afc06bbd0 msgr2=0x7f6afc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f6afc06bbd0 0x7f6afc06e090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c146b10 tx=0x7f6b0c007f00 comp rx=0 tx=0).stop 2024-03-23T23:56:40.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c0b5210 msgr2=0x7f6b1c1431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c0b5210 0x7f6b1c1431f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b08033000 tx=0x7f6b08004730 comp rx=0 tx=0).stop 2024-03-23T23:56:40.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 shutdown_connections 2024-03-23T23:56:40.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f6afc06bbd0 0x7f6afc06e090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0b9850 0x7f6b1c1495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1c0b6bc0 0x7f6b1c1490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 --2- 172.21.15.31:0/4095000753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c0b5210 0x7f6b1c1431f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.511+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 >> 172.21.15.31:0/4095000753 conn(0x7f6b1c066fb0 msgr2=0x7f6b1c0bd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.512+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 shutdown_connections 2024-03-23T23:56:40.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.512+0000 7f6b20a00640 1 -- 172.21.15.31:0/4095000753 wait complete. 2024-03-23T23:56:40.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.521+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa0d4005710 con 0x7fa0d4152760 2024-03-23T23:56:40.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.522+0000 7fa0cf400640 1 -- 172.21.15.31:0/1563143400 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa0dc08f030 con 0x7fa0d4152760 2024-03-23T23:56:40.522 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2024-03-23T23:56:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.525+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fa0bc06bcd0 msgr2=0x7fa0bc06e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.525+0000 7fa0e2400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fa0bc06bcd0 0x7fa0bc06e190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0036000 tx=0x7fa0d0008030 comp rx=0 tx=0).stop 2024-03-23T23:56:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.525+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d4152760 msgr2=0x7fa0d4165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.525+0000 7fa0e2400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d4152760 0x7fa0d4165770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc050670 tx=0x7fa0dc0692b0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.526+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 shutdown_connections 2024-03-23T23:56:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.526+0000 7fa0e2400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fa0bc06bcd0 0x7fa0bc06e190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.526+0000 7fa0e2400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d4165cb0 0x7fa0d4157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.526+0000 7fa0e2400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0d4152760 0x7fa0d4165770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.526+0000 7fa0e2400640 1 --2- 172.21.15.31:0/1563143400 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0d403a270 0x7fa0d40c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.526+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 >> 172.21.15.31:0/1563143400 conn(0x7fa0d403eab0 msgr2=0x7fa0d40c2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.527+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 shutdown_connections 2024-03-23T23:56:40.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.527+0000 7fa0e2400640 1 -- 172.21.15.31:0/1563143400 wait complete. 2024-03-23T23:56:40.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.4 2024-03-23T23:56:40.530 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2024-03-23T23:56:40.530 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.535+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5d4c06b680 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.536+0000 7f5d49600640 1 -- 172.21.15.31:0/3592084284 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5d4405c900 con 0x7f5d4c0b23d0 2024-03-23T23:56:40.536 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2024-03-23T23:56:40.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5d2c06bc00 msgr2=0x7f5d2c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5d2c06bc00 0x7f5d2c06e0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c071870 tx=0x7f5d40007f10 comp rx=0 tx=0).stop 2024-03-23T23:56:40.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d4c0b23d0 msgr2=0x7f5d4c071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d4c0b23d0 0x7f5d4c071d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d440016e0 tx=0x7f5d4400cf50 comp rx=0 tx=0).stop 2024-03-23T23:56:40.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 shutdown_connections 2024-03-23T23:56:40.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5d2c06bc00 0x7f5d2c06e0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d4c1449e0 0x7f5d4c070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d4c0b5a70 0x7f5d4c0705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 --2- 172.21.15.31:0/3592084284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d4c0b23d0 0x7f5d4c071d20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 >> 172.21.15.31:0/3592084284 conn(0x7f5d4c066fb0 msgr2=0x7f5d4c0b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 shutdown_connections 2024-03-23T23:56:40.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.538+0000 7f5d54600640 1 -- 172.21.15.31:0/3592084284 wait complete. 2024-03-23T23:56:40.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.540+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f180c073060 con 0x7f180c142220 2024-03-23T23:56:40.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.540+0000 7f1803e00640 1 -- 172.21.15.31:0/4024268489 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f17fc07e8e0 con 0x7f180c142220 2024-03-23T23:56:40.541 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2024-03-23T23:56:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f17e806bc00 msgr2=0x7f17e806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f17e806bc00 0x7f17e806e0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f180c145190 tx=0x7f1804007aa0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f180c142220 msgr2=0x7f180c13e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f180c142220 0x7f180c13e6f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f180c0b4a70 tx=0x7f17fc003a70 comp rx=0 tx=0).stop 2024-03-23T23:56:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 shutdown_connections 2024-03-23T23:56:40.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f17e806bc00 0x7f17e806e0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f180c142220 0x7f180c13e6f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f180c140c50 0x7f180c141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 --2- 172.21.15.31:0/4024268489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17f00051c0 0x7f180c13f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 >> 172.21.15.31:0/4024268489 conn(0x7f180c066fb0 msgr2=0x7f180c0b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 shutdown_connections 2024-03-23T23:56:40.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.544+0000 7f1812e00640 1 -- 172.21.15.31:0/4024268489 wait complete. 2024-03-23T23:56:40.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2024-03-23T23:56:40.551 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.6 2024-03-23T23:56:40.557 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.561+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3390145260 con 0x7f3390143860 2024-03-23T23:56:40.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2024-03-23T23:56:40.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.562+0000 7f3387e00640 1 -- 172.21.15.31:0/211237974 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f338805a330 con 0x7f3390143860 2024-03-23T23:56:40.563 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2024-03-23T23:56:40.563 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.563+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0404142190 con 0x7f04040b5780 2024-03-23T23:56:40.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f03faa00640 1 -- 172.21.15.31:0/437166226 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03fc07b360 con 0x7f04040b5780 2024-03-23T23:56:40.564 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2024-03-23T23:56:40.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f337006bdd0 msgr2=0x7f337006e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f337006bdd0 0x7f337006e290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3380038000 tx=0x7f3380032000 comp rx=0 tx=0).stop 2024-03-23T23:56:40.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3390143860 msgr2=0x7f33901d2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3390143860 0x7f33901d2830 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3388007e60 tx=0x7f338800e4b0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 shutdown_connections 2024-03-23T23:56:40.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f337006bdd0 0x7f337006e290 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33900b5b60 0x7f33901dc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3390143860 0x7f33901d2830 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 --2- 172.21.15.31:0/211237974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33900b5780 0x7f3390146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 >> 172.21.15.31:0/211237974 conn(0x7f3390066dd0 msgr2=0x7f3390141310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.564+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 shutdown_connections 2024-03-23T23:56:40.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.565+0000 7f3397200640 1 -- 172.21.15.31:0/211237974 wait complete. 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f03e406bc50 msgr2=0x7f03e406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f03e406bc50 0x7f03e406e110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f040413b460 tx=0x7f03f4009040 comp rx=0 tx=0).stop 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 msgr2=0x7f040413aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f040413aa10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00f3a0 tx=0x7f03fc004a40 comp rx=0 tx=0).stop 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 shutdown_connections 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f03e406bc50 0x7f03e406e110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04040b5b60 0x7f0404138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0404143860 0x7f0404138fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 --2- 172.21.15.31:0/437166226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04040b5780 0x7f040413aa10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 >> 172.21.15.31:0/437166226 conn(0x7f0404066dd0 msgr2=0x7f0404142990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 shutdown_connections 2024-03-23T23:56:40.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.566+0000 7f0409a00640 1 -- 172.21.15.31:0/437166226 wait complete. 2024-03-23T23:56:40.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-03-23T23:56:40.583 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2024-03-23T23:56:40.583 DEBUG:teuthology.parallel:result is None 2024-03-23T23:56:40.583 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-23T23:56:40.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:56:40.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.837+0000 7fb0d3200640 1 Processor -- start 2024-03-23T23:56:40.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.837+0000 7fb0d3200640 1 -- start start 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.838+0000 7fb0d3200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0d40b7530 0x7fb0d4144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d3200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0d40b79e0 0x7fb0d4144850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d3200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d40b6e10 con 0x7fb0d40b6a30 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d3200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40b3480 con 0x7fb0d40b79e0 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d3200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d40b36d0 con 0x7fb0d40b7530 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d2800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0d40b79e0 0x7fb0d4144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d2800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0d40b79e0 0x7fb0d4144850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33064/0 (socket says 172.21.15.31:33064) 2024-03-23T23:56:40.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d2800640 1 -- 172.21.15.31:0/1432679890 learned_addr learned my addr 172.21.15.31:0/1432679890 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d2800640 1 -- 172.21.15.31:0/1432679890 >> v2:172.21.15.59:3300/0 conn(0x7fb0d40b7530 msgr2=0x7fb0d4144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d2800640 1 --2- 172.21.15.31:0/1432679890 >> v2:172.21.15.59:3300/0 conn(0x7fb0d40b7530 0x7fb0d4144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d2800640 1 -- 172.21.15.31:0/1432679890 >> v1:172.21.15.59:6789/0 conn(0x7fb0d40b6a30 legacy=0x7fb0d40b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:40.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.839+0000 7fb0d2800640 1 -- 172.21.15.31:0/1432679890 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40b3d20 con 0x7fb0d40b79e0 2024-03-23T23:56:40.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.840+0000 7fb0d2800640 1 --2- 172.21.15.31:0/1432679890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d4144850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40b3600 tx=0x7fb0cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b750a88f4394f135 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d1400640 1 -- 172.21.15.31:0/1432679890 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc02ca70 con 0x7fb0d40b79e0 2024-03-23T23:56:40.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d1400640 1 -- 172.21.15.31:0/1432679890 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc02cc10 con 0x7fb0d40b79e0 2024-03-23T23:56:40.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d1400640 1 -- 172.21.15.31:0/1432679890 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0343f0 con 0x7fb0d40b79e0 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d3200640 1 -- 172.21.15.31:0/1432679890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 msgr2=0x7fb0d4144850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d3200640 1 --2- 172.21.15.31:0/1432679890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d4144850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40b3600 tx=0x7fb0cc02bed0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d3200640 1 -- 172.21.15.31:0/1432679890 shutdown_connections 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d3200640 1 --2- 172.21.15.31:0/1432679890 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d4144850 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.841+0000 7fb0d3200640 1 --2- 172.21.15.31:0/1432679890 >> v2:172.21.15.59:3300/0 conn(0x7fb0d40b7530 0x7fb0d4144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.842+0000 7fb0d3200640 1 -- 172.21.15.31:0/1432679890 >> 172.21.15.31:0/1432679890 conn(0x7fb0d406cf40 msgr2=0x7fb0d406ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.842+0000 7fb0d3200640 1 -- 172.21.15.31:0/1432679890 shutdown_connections 2024-03-23T23:56:40.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.842+0000 7fb0d3200640 1 -- 172.21.15.31:0/1432679890 wait complete. 2024-03-23T23:56:40.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.843+0000 7fb0d3200640 1 Processor -- start 2024-03-23T23:56:40.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.843+0000 7fb0d3200640 1 -- start start 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d3200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d40b6a30 0x7fb0d40afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d40b7530 0x7fb0d40b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d3200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d41dfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d3200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40b4800 con 0x7fb0d40b79e0 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40b42e0 con 0x7fb0d40b7530 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d3200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d40b4980 con 0x7fb0d40b6a30 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d41dfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d41dfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33078/0 (socket says 172.21.15.31:33078) 2024-03-23T23:56:40.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.844+0000 7fb0d2800640 1 -- 172.21.15.31:0/3380431803 learned_addr learned my addr 172.21.15.31:0/3380431803 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d1e00640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d40b6a30 0x7fb0d40afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0c9400640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d40b7530 0x7fb0d40b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d2800640 1 -- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d40b6a30 msgr2=0x7fb0d40afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d2800640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d40b6a30 0x7fb0d40afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d2800640 1 -- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d40b7530 msgr2=0x7fb0d40b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d2800640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d40b7530 0x7fb0d40b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d2800640 1 -- 172.21.15.31:0/3380431803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d40b2090 con 0x7fb0d40b79e0 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d2800640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d41dfc10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc036040 tx=0x7fb0cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0caa00640 1 -- 172.21.15.31:0/3380431803 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc043020 con 0x7fb0d40b79e0 2024-03-23T23:56:40.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0caa00640 1 -- 172.21.15.31:0/3380431803 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc03e450 con 0x7fb0d40b79e0 2024-03-23T23:56:40.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0caa00640 1 -- 172.21.15.31:0/3380431803 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc009510 con 0x7fb0d40b79e0 2024-03-23T23:56:40.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d40b2310 con 0x7fb0d40b79e0 2024-03-23T23:56:40.850 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.845+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d41e0730 con 0x7fb0d40b79e0 2024-03-23T23:56:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.847+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d40752c0 con 0x7fb0d40b79e0 2024-03-23T23:56:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.847+0000 7fb0caa00640 1 -- 172.21.15.31:0/3380431803 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb0cc046020 con 0x7fb0d40b79e0 2024-03-23T23:56:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.848+0000 7fb0caa00640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb0b006bbd0 0x7fb0b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:40.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.848+0000 7fb0caa00640 1 -- 172.21.15.31:0/3380431803 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc0ad400 con 0x7fb0d40b79e0 2024-03-23T23:56:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.849+0000 7fb0d1e00640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb0b006bbd0 0x7fb0b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.850+0000 7fb0d1e00640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb0b006bbd0 0x7fb0b006e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4003d90 tx=0x7fb0c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:40.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:40.853+0000 7fb0caa00640 1 -- 172.21.15.31:0/3380431803 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fb0cc04d030 con 0x7fb0d40b79e0 2024-03-23T23:56:41.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.043+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0d4147390 con 0x7fb0b006bbd0 2024-03-23T23:56:41.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.063+0000 7fb0caa00640 1 -- 172.21.15.31:0/3380431803 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251836 (secure 0 0 0) 0x7fb0d4147390 con 0x7fb0b006bbd0 2024-03-23T23:56:41.067 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:41.068 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb0b006bbd0 msgr2=0x7fb0b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb0b006bbd0 0x7fb0b006e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4003d90 tx=0x7fb0c4009040 comp rx=0 tx=0).stop 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 msgr2=0x7fb0d41dfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d41dfc10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc036040 tx=0x7fb0cc004a40 comp rx=0 tx=0).stop 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 shutdown_connections 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb0b006bbd0 0x7fb0b006e090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d40b7530 0x7fb0d40b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0d40b79e0 0x7fb0d41dfc10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 --2- 172.21.15.31:0/3380431803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0d40b6a30 0x7fb0d40afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 >> 172.21.15.31:0/3380431803 conn(0x7fb0d406cf40 msgr2=0x7fb0d4143080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 shutdown_connections 2024-03-23T23:56:41.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.069+0000 7fb0d3200640 1 -- 172.21.15.31:0/3380431803 wait complete. 2024-03-23T23:56:41.085 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-23T23:56:39.321419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.477385"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880786+0000","last_change":"2024-03-23T23:56:30.885878+0000","last_active":"2024-03-23T23:56:31.880786+0000","last_peered":"2024-03-23T23:56:31.880786+0000","last_clean":"2024-03-23T23:56:31.880786+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:56:31.880786+0000","last_undegraded":"2024-03-23T23:56:31.880786+0000","last_fullsized":"2024-03-23T23:56:31.880786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886363+0000","last_change":"2024-03-23T23:56:30.875303+0000","last_active":"2024-03-23T23:56:31.886363+0000","last_peered":"2024-03-23T23:56:31.886363+0000","last_clean":"2024-03-23T23:56:31.886363+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:56:31.886363+0000","last_undegraded":"2024-03-23T23:56:31.886363+0000","last_fullsized":"2024-03-23T23:56:31.886363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257583+0000","last_change":"2024-03-23T23:56:30.883893+0000","last_active":"2024-03-23T23:56:32.257583+0000","last_peered":"2024-03-23T23:56:32.257583+0000","last_clean":"2024-03-23T23:56:32.257583+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:56:32.257583+0000","last_undegraded":"2024-03-23T23:56:32.257583+0000","last_fullsized":"2024-03-23T23:56:32.257583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254511+0000","last_change":"2024-03-23T23:56:30.891008+0000","last_active":"2024-03-23T23:56:32.254511+0000","last_peered":"2024-03-23T23:56:32.254511+0000","last_clean":"2024-03-23T23:56:32.254511+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:56:32.254511+0000","last_undegraded":"2024-03-23T23:56:32.254511+0000","last_fullsized":"2024-03-23T23:56:32.254511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880448+0000","last_change":"2024-03-23T23:56:30.877242+0000","last_active":"2024-03-23T23:56:31.880448+0000","last_peered":"2024-03-23T23:56:31.880448+0000","last_clean":"2024-03-23T23:56:31.880448+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:56:31.880448+0000","last_undegraded":"2024-03-23T23:56:31.880448+0000","last_fullsized":"2024-03-23T23:56:31.880448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254330+0000","last_change":"2024-03-23T23:56:30.890268+0000","last_active":"2024-03-23T23:56:32.254330+0000","last_peered":"2024-03-23T23:56:32.254330+0000","last_clean":"2024-03-23T23:56:32.254330+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:56:32.254330+0000","last_undegraded":"2024-03-23T23:56:32.254330+0000","last_fullsized":"2024-03-23T23:56:32.254330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880096+0000","last_change":"2024-03-23T23:56:30.885059+0000","last_active":"2024-03-23T23:56:31.880096+0000","last_peered":"2024-03-23T23:56:31.880096+0000","last_clean":"2024-03-23T23:56:31.880096+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:56:31.880096+0000","last_undegraded":"2024-03-23T23:56:31.880096+0000","last_fullsized":"2024-03-23T23:56:31.880096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253729+0000","last_change":"2024-03-23T23:56:30.881077+0000","last_active":"2024-03-23T23:56:32.253729+0000","last_peered":"2024-03-23T23:56:32.253729+0000","last_clean":"2024-03-23T23:56:32.253729+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:56:32.253729+0000","last_undegraded":"2024-03-23T23:56:32.253729+0000","last_fullsized":"2024-03-23T23:56:32.253729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881033+0000","last_change":"2024-03-23T23:56:30.883587+0000","last_active":"2024-03-23T23:56:31.881033+0000","last_peered":"2024-03-23T23:56:31.881033+0000","last_clean":"2024-03-23T23:56:31.881033+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:56:31.881033+0000","last_undegraded":"2024-03-23T23:56:31.881033+0000","last_fullsized":"2024-03-23T23:56:31.881033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879573+0000","last_change":"2024-03-23T23:56:30.888454+0000","last_active":"2024-03-23T23:56:31.879573+0000","last_peered":"2024-03-23T23:56:31.879573+0000","last_clean":"2024-03-23T23:56:31.879573+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:56:31.879573+0000","last_undegraded":"2024-03-23T23:56:31.879573+0000","last_fullsized":"2024-03-23T23:56:31.879573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879166+0000","last_change":"2024-03-23T23:56:30.881125+0000","last_active":"2024-03-23T23:56:31.879166+0000","last_peered":"2024-03-23T23:56:31.879166+0000","last_clean":"2024-03-23T23:56:31.879166+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:56:31.879166+0000","last_undegraded":"2024-03-23T23:56:31.879166+0000","last_fullsized":"2024-03-23T23:56:31.879166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879683+0000","last_change":"2024-03-23T23:56:30.863287+0000","last_active":"2024-03-23T23:56:31.879683+0000","last_peered":"2024-03-23T23:56:31.879683+0000","last_clean":"2024-03-23T23:56:31.879683+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:56:31.879683+0000","last_undegraded":"2024-03-23T23:56:31.879683+0000","last_fullsized":"2024-03-23T23:56:31.879683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:00.178139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258712+0000","last_change":"2024-03-23T23:56:30.881169+0000","last_active":"2024-03-23T23:56:32.258712+0000","last_peered":"2024-03-23T23:56:32.258712+0000","last_clean":"2024-03-23T23:56:32.258712+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:56:32.258712+0000","last_undegraded":"2024-03-23T23:56:32.258712+0000","last_fullsized":"2024-03-23T23:56:32.258712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256704+0000","last_change":"2024-03-23T23:56:30.876653+0000","last_active":"2024-03-23T23:56:32.256704+0000","last_peered":"2024-03-23T23:56:32.256704+0000","last_clean":"2024-03-23T23:56:32.256704+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:56:32.256704+0000","last_undegraded":"2024-03-23T23:56:32.256704+0000","last_fullsized":"2024-03-23T23:56:32.256704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:58:31.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885707+0000","last_change":"2024-03-23T23:56:30.862687+0000","last_active":"2024-03-23T23:56:31.885707+0000","last_peered":"2024-03-23T23:56:31.885707+0000","last_clean":"2024-03-23T23:56:31.885707+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:56:31.885707+0000","last_undegraded":"2024-03-23T23:56:31.885707+0000","last_fullsized":"2024-03-23T23:56:31.885707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254454+0000","last_change":"2024-03-23T23:56:30.882976+0000","last_active":"2024-03-23T23:56:32.254454+0000","last_peered":"2024-03-23T23:56:32.254454+0000","last_clean":"2024-03-23T23:56:32.254454+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:56:32.254454+0000","last_undegraded":"2024-03-23T23:56:32.254454+0000","last_fullsized":"2024-03-23T23:56:32.254454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256051+0000","last_change":"2024-03-23T23:56:30.895060+0000","last_active":"2024-03-23T23:56:32.256051+0000","last_peered":"2024-03-23T23:56:32.256051+0000","last_clean":"2024-03-23T23:56:32.256051+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:56:32.256051+0000","last_undegraded":"2024-03-23T23:56:32.256051+0000","last_fullsized":"2024-03-23T23:56:32.256051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255325+0000","last_change":"2024-03-23T23:56:30.892332+0000","last_active":"2024-03-23T23:56:32.255325+0000","last_peered":"2024-03-23T23:56:32.255325+0000","last_clean":"2024-03-23T23:56:32.255325+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:56:32.255325+0000","last_undegraded":"2024-03-23T23:56:32.255325+0000","last_fullsized":"2024-03-23T23:56:32.255325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881381+0000","last_change":"2024-03-23T23:56:30.881290+0000","last_active":"2024-03-23T23:56:31.881381+0000","last_peered":"2024-03-23T23:56:31.881381+0000","last_clean":"2024-03-23T23:56:31.881381+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:56:31.881381+0000","last_undegraded":"2024-03-23T23:56:31.881381+0000","last_fullsized":"2024-03-23T23:56:31.881381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:54:18.265054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879417+0000","last_change":"2024-03-23T23:56:30.875425+0000","last_active":"2024-03-23T23:56:31.879417+0000","last_peered":"2024-03-23T23:56:31.879417+0000","last_clean":"2024-03-23T23:56:31.879417+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:56:31.879417+0000","last_undegraded":"2024-03-23T23:56:31.879417+0000","last_fullsized":"2024-03-23T23:56:31.879417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257198+0000","last_change":"2024-03-23T23:56:30.884434+0000","last_active":"2024-03-23T23:56:32.257198+0000","last_peered":"2024-03-23T23:56:32.257198+0000","last_clean":"2024-03-23T23:56:32.257198+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:56:32.257198+0000","last_undegraded":"2024-03-23T23:56:32.257198+0000","last_fullsized":"2024-03-23T23:56:32.257198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254512+0000","last_change":"2024-03-23T23:56:30.892649+0000","last_active":"2024-03-23T23:56:32.254512+0000","last_peered":"2024-03-23T23:56:32.254512+0000","last_clean":"2024-03-23T23:56:32.254512+0000","last_became_active":"2024-03-23T23:56:30.891572+0000","last_became_peered":"2024-03-23T23:56:30.891572+0000","last_unstale":"2024-03-23T23:56:32.254512+0000","last_undegraded":"2024-03-23T23:56:32.254512+0000","last_fullsized":"2024-03-23T23:56:32.254512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253862+0000","last_change":"2024-03-23T23:56:30.888046+0000","last_active":"2024-03-23T23:56:32.253862+0000","last_peered":"2024-03-23T23:56:32.253862+0000","last_clean":"2024-03-23T23:56:32.253862+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:56:32.253862+0000","last_undegraded":"2024-03-23T23:56:32.253862+0000","last_fullsized":"2024-03-23T23:56:32.253862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254485+0000","last_change":"2024-03-23T23:56:30.886470+0000","last_active":"2024-03-23T23:56:32.254485+0000","last_peered":"2024-03-23T23:56:32.254485+0000","last_clean":"2024-03-23T23:56:32.254485+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:56:32.254485+0000","last_undegraded":"2024-03-23T23:56:32.254485+0000","last_fullsized":"2024-03-23T23:56:32.254485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257949+0000","last_change":"2024-03-23T23:56:30.885446+0000","last_active":"2024-03-23T23:56:32.257949+0000","last_peered":"2024-03-23T23:56:32.257949+0000","last_clean":"2024-03-23T23:56:32.257949+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:56:32.257949+0000","last_undegraded":"2024-03-23T23:56:32.257949+0000","last_fullsized":"2024-03-23T23:56:32.257949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879747+0000","last_change":"2024-03-23T23:56:30.882609+0000","last_active":"2024-03-23T23:56:31.879747+0000","last_peered":"2024-03-23T23:56:31.879747+0000","last_clean":"2024-03-23T23:56:31.879747+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:56:31.879747+0000","last_undegraded":"2024-03-23T23:56:31.879747+0000","last_fullsized":"2024-03-23T23:56:31.879747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886361+0000","last_change":"2024-03-23T23:56:30.881031+0000","last_active":"2024-03-23T23:56:31.886361+0000","last_peered":"2024-03-23T23:56:31.886361+0000","last_clean":"2024-03-23T23:56:31.886361+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:56:31.886361+0000","last_undegraded":"2024-03-23T23:56:31.886361+0000","last_fullsized":"2024-03-23T23:56:31.886361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258083+0000","last_change":"2024-03-23T23:56:30.887942+0000","last_active":"2024-03-23T23:56:32.258083+0000","last_peered":"2024-03-23T23:56:32.258083+0000","last_clean":"2024-03-23T23:56:32.258083+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:56:32.258083+0000","last_undegraded":"2024-03-23T23:56:32.258083+0000","last_fullsized":"2024-03-23T23:56:32.258083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257607+0000","last_change":"2024-03-23T23:56:30.882527+0000","last_active":"2024-03-23T23:56:32.257607+0000","last_peered":"2024-03-23T23:56:32.257607+0000","last_clean":"2024-03-23T23:56:32.257607+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:56:32.257607+0000","last_undegraded":"2024-03-23T23:56:32.257607+0000","last_fullsized":"2024-03-23T23:56:32.257607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254651+0000","last_change":"2024-03-23T23:56:30.885451+0000","last_active":"2024-03-23T23:56:32.254651+0000","last_peered":"2024-03-23T23:56:32.254651+0000","last_clean":"2024-03-23T23:56:32.254651+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:56:32.254651+0000","last_undegraded":"2024-03-23T23:56:32.254651+0000","last_fullsized":"2024-03-23T23:56:32.254651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255346+0000","last_change":"2024-03-23T23:56:30.880152+0000","last_active":"2024-03-23T23:56:32.255346+0000","last_peered":"2024-03-23T23:56:32.255346+0000","last_clean":"2024-03-23T23:56:32.255346+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:56:32.255346+0000","last_undegraded":"2024-03-23T23:56:32.255346+0000","last_fullsized":"2024-03-23T23:56:32.255346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:17.288541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.878895+0000","last_change":"2024-03-23T23:56:30.880378+0000","last_active":"2024-03-23T23:56:31.878895+0000","last_peered":"2024-03-23T23:56:31.878895+0000","last_clean":"2024-03-23T23:56:31.878895+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:56:31.878895+0000","last_undegraded":"2024-03-23T23:56:31.878895+0000","last_fullsized":"2024-03-23T23:56:31.878895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879226+0000","last_change":"2024-03-23T23:56:30.869148+0000","last_active":"2024-03-23T23:56:31.879226+0000","last_peered":"2024-03-23T23:56:31.879226+0000","last_clean":"2024-03-23T23:56:31.879226+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:56:31.879226+0000","last_undegraded":"2024-03-23T23:56:31.879226+0000","last_fullsized":"2024-03-23T23:56:31.879226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:38.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257347+0000","last_change":"2024-03-23T23:56:29.890549+0000","last_active":"2024-03-23T23:56:32.257347+0000","last_peered":"2024-03-23T23:56:32.257347+0000","last_clean":"2024-03-23T23:56:32.257347+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:56:32.257347+0000","last_undegraded":"2024-03-23T23:56:32.257347+0000","last_fullsized":"2024-03-23T23:56:32.257347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257985+0000","last_change":"2024-03-23T23:56:30.885979+0000","last_active":"2024-03-23T23:56:32.257985+0000","last_peered":"2024-03-23T23:56:32.257985+0000","last_clean":"2024-03-23T23:56:32.257985+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:56:32.257985+0000","last_undegraded":"2024-03-23T23:56:32.257985+0000","last_fullsized":"2024-03-23T23:56:32.257985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879119+0000","last_change":"2024-03-23T23:56:29.892444+0000","last_active":"2024-03-23T23:56:31.879119+0000","last_peered":"2024-03-23T23:56:31.879119+0000","last_clean":"2024-03-23T23:56:31.879119+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:56:31.879119+0000","last_undegraded":"2024-03-23T23:56:31.879119+0000","last_fullsized":"2024-03-23T23:56:31.879119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254322+0000","last_change":"2024-03-23T23:56:29.887065+0000","last_active":"2024-03-23T23:56:32.254322+0000","last_peered":"2024-03-23T23:56:32.254322+0000","last_clean":"2024-03-23T23:56:32.254322+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:56:32.254322+0000","last_undegraded":"2024-03-23T23:56:32.254322+0000","last_fullsized":"2024-03-23T23:56:32.254322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:05:45.290286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253905+0000","last_change":"2024-03-23T23:56:30.881409+0000","last_active":"2024-03-23T23:56:32.253905+0000","last_peered":"2024-03-23T23:56:32.253905+0000","last_clean":"2024-03-23T23:56:32.253905+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:56:32.253905+0000","last_undegraded":"2024-03-23T23:56:32.253905+0000","last_fullsized":"2024-03-23T23:56:32.253905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254835+0000","last_change":"2024-03-23T23:56:29.897340+0000","last_active":"2024-03-23T23:56:32.254835+0000","last_peered":"2024-03-23T23:56:32.254835+0000","last_clean":"2024-03-23T23:56:32.254835+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:56:32.254835+0000","last_undegraded":"2024-03-23T23:56:32.254835+0000","last_fullsized":"2024-03-23T23:56:32.254835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885515+0000","last_change":"2024-03-23T23:56:30.876574+0000","last_active":"2024-03-23T23:56:31.885515+0000","last_peered":"2024-03-23T23:56:31.885515+0000","last_clean":"2024-03-23T23:56:31.885515+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:56:31.885515+0000","last_undegraded":"2024-03-23T23:56:31.885515+0000","last_fullsized":"2024-03-23T23:56:31.885515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880683+0000","last_change":"2024-03-23T23:56:29.894494+0000","last_active":"2024-03-23T23:56:31.880683+0000","last_peered":"2024-03-23T23:56:31.880683+0000","last_clean":"2024-03-23T23:56:31.880683+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:56:31.880683+0000","last_undegraded":"2024-03-23T23:56:31.880683+0000","last_fullsized":"2024-03-23T23:56:31.880683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255328+0000","last_change":"2024-03-23T23:56:30.891335+0000","last_active":"2024-03-23T23:56:32.255328+0000","last_peered":"2024-03-23T23:56:32.255328+0000","last_clean":"2024-03-23T23:56:32.255328+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:56:32.255328+0000","last_undegraded":"2024-03-23T23:56:32.255328+0000","last_fullsized":"2024-03-23T23:56:32.255328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255238+0000","last_change":"2024-03-23T23:56:29.886369+0000","last_active":"2024-03-23T23:56:32.255238+0000","last_peered":"2024-03-23T23:56:32.255238+0000","last_clean":"2024-03-23T23:56:32.255238+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:56:32.255238+0000","last_undegraded":"2024-03-23T23:56:32.255238+0000","last_fullsized":"2024-03-23T23:56:32.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257122+0000","last_change":"2024-03-23T23:56:30.876882+0000","last_active":"2024-03-23T23:56:32.257122+0000","last_peered":"2024-03-23T23:56:32.257122+0000","last_clean":"2024-03-23T23:56:32.257122+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:56:32.257122+0000","last_undegraded":"2024-03-23T23:56:32.257122+0000","last_fullsized":"2024-03-23T23:56:32.257122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886446+0000","last_change":"2024-03-23T23:56:29.886611+0000","last_active":"2024-03-23T23:56:31.886446+0000","last_peered":"2024-03-23T23:56:31.886446+0000","last_clean":"2024-03-23T23:56:31.886446+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:56:31.886446+0000","last_undegraded":"2024-03-23T23:56:31.886446+0000","last_fullsized":"2024-03-23T23:56:31.886446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879896+0000","last_change":"2024-03-23T23:56:30.871258+0000","last_active":"2024-03-23T23:56:31.879896+0000","last_peered":"2024-03-23T23:56:31.879896+0000","last_clean":"2024-03-23T23:56:31.879896+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:56:31.879896+0000","last_undegraded":"2024-03-23T23:56:31.879896+0000","last_fullsized":"2024-03-23T23:56:31.879896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:12.879233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879697+0000","last_change":"2024-03-23T23:56:29.886316+0000","last_active":"2024-03-23T23:56:31.879697+0000","last_peered":"2024-03-23T23:56:31.879697+0000","last_clean":"2024-03-23T23:56:31.879697+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:56:31.879697+0000","last_undegraded":"2024-03-23T23:56:31.879697+0000","last_fullsized":"2024-03-23T23:56:31.879697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880255+0000","last_change":"2024-03-23T23:56:30.885592+0000","last_active":"2024-03-23T23:56:31.880255+0000","last_peered":"2024-03-23T23:56:31.880255+0000","last_clean":"2024-03-23T23:56:31.880255+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:56:31.880255+0000","last_undegraded":"2024-03-23T23:56:31.880255+0000","last_fullsized":"2024-03-23T23:56:31.880255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258275+0000","last_change":"2024-03-23T23:56:29.891265+0000","last_active":"2024-03-23T23:56:32.258275+0000","last_peered":"2024-03-23T23:56:32.258275+0000","last_clean":"2024-03-23T23:56:32.258275+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:56:32.258275+0000","last_undegraded":"2024-03-23T23:56:32.258275+0000","last_fullsized":"2024-03-23T23:56:32.258275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:53.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258434+0000","last_change":"2024-03-23T23:56:30.886240+0000","last_active":"2024-03-23T23:56:32.258434+0000","last_peered":"2024-03-23T23:56:32.258434+0000","last_clean":"2024-03-23T23:56:32.258434+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:56:32.258434+0000","last_undegraded":"2024-03-23T23:56:32.258434+0000","last_fullsized":"2024-03-23T23:56:32.258434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254833+0000","last_change":"2024-03-23T23:56:29.890485+0000","last_active":"2024-03-23T23:56:32.254833+0000","last_peered":"2024-03-23T23:56:32.254833+0000","last_clean":"2024-03-23T23:56:32.254833+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:56:32.254833+0000","last_undegraded":"2024-03-23T23:56:32.254833+0000","last_fullsized":"2024-03-23T23:56:32.254833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880483+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:56:31.880483+0000","last_peered":"2024-03-23T23:56:31.880483+0000","last_clean":"2024-03-23T23:56:31.880483+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:56:31.880483+0000","last_undegraded":"2024-03-23T23:56:31.880483+0000","last_fullsized":"2024-03-23T23:56:31.880483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879506+0000","last_change":"2024-03-23T23:56:29.896833+0000","last_active":"2024-03-23T23:56:31.879506+0000","last_peered":"2024-03-23T23:56:31.879506+0000","last_clean":"2024-03-23T23:56:31.879506+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:56:31.879506+0000","last_undegraded":"2024-03-23T23:56:31.879506+0000","last_fullsized":"2024-03-23T23:56:31.879506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879148+0000","last_change":"2024-03-23T23:56:30.876178+0000","last_active":"2024-03-23T23:56:31.879148+0000","last_peered":"2024-03-23T23:56:31.879148+0000","last_clean":"2024-03-23T23:56:31.879148+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:56:31.879148+0000","last_undegraded":"2024-03-23T23:56:31.879148+0000","last_fullsized":"2024-03-23T23:56:31.879148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255878+0000","last_change":"2024-03-23T23:56:29.879437+0000","last_active":"2024-03-23T23:56:32.255878+0000","last_peered":"2024-03-23T23:56:32.255878+0000","last_clean":"2024-03-23T23:56:32.255878+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:56:32.255878+0000","last_undegraded":"2024-03-23T23:56:32.255878+0000","last_fullsized":"2024-03-23T23:56:32.255878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880229+0000","last_change":"2024-03-23T23:56:30.888310+0000","last_active":"2024-03-23T23:56:31.880229+0000","last_peered":"2024-03-23T23:56:31.880229+0000","last_clean":"2024-03-23T23:56:31.880229+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:56:31.880229+0000","last_undegraded":"2024-03-23T23:56:31.880229+0000","last_fullsized":"2024-03-23T23:56:31.880229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881660+0000","last_change":"2024-03-23T23:56:29.892548+0000","last_active":"2024-03-23T23:56:31.881660+0000","last_peered":"2024-03-23T23:56:31.881660+0000","last_clean":"2024-03-23T23:56:31.881660+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:56:31.881660+0000","last_undegraded":"2024-03-23T23:56:31.881660+0000","last_fullsized":"2024-03-23T23:56:31.881660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:53:30.285127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880515+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:56:31.880515+0000","last_peered":"2024-03-23T23:56:31.880515+0000","last_clean":"2024-03-23T23:56:31.880515+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:56:31.880515+0000","last_undegraded":"2024-03-23T23:56:31.880515+0000","last_fullsized":"2024-03-23T23:56:31.880515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255780+0000","last_change":"2024-03-23T23:56:29.883486+0000","last_active":"2024-03-23T23:56:32.255780+0000","last_peered":"2024-03-23T23:56:32.255780+0000","last_clean":"2024-03-23T23:56:32.255780+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:56:32.255780+0000","last_undegraded":"2024-03-23T23:56:32.255780+0000","last_fullsized":"2024-03-23T23:56:32.255780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881016+0000","last_change":"2024-03-23T23:56:30.887560+0000","last_active":"2024-03-23T23:56:31.881016+0000","last_peered":"2024-03-23T23:56:31.881016+0000","last_clean":"2024-03-23T23:56:31.881016+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:56:31.881016+0000","last_undegraded":"2024-03-23T23:56:31.881016+0000","last_fullsized":"2024-03-23T23:56:31.881016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886628+0000","last_change":"2024-03-23T23:56:29.897890+0000","last_active":"2024-03-23T23:56:31.886628+0000","last_peered":"2024-03-23T23:56:31.886628+0000","last_clean":"2024-03-23T23:56:31.886628+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:56:31.886628+0000","last_undegraded":"2024-03-23T23:56:31.886628+0000","last_fullsized":"2024-03-23T23:56:31.886628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255074+0000","last_change":"2024-03-23T23:56:30.888006+0000","last_active":"2024-03-23T23:56:32.255074+0000","last_peered":"2024-03-23T23:56:32.255074+0000","last_clean":"2024-03-23T23:56:32.255074+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:56:32.255074+0000","last_undegraded":"2024-03-23T23:56:32.255074+0000","last_fullsized":"2024-03-23T23:56:32.255074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254929+0000","last_change":"2024-03-23T23:56:29.888464+0000","last_active":"2024-03-23T23:56:32.254929+0000","last_peered":"2024-03-23T23:56:32.254929+0000","last_clean":"2024-03-23T23:56:32.254929+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:56:32.254929+0000","last_undegraded":"2024-03-23T23:56:32.254929+0000","last_fullsized":"2024-03-23T23:56:32.254929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881147+0000","last_change":"2024-03-23T23:56:30.883536+0000","last_active":"2024-03-23T23:56:31.881147+0000","last_peered":"2024-03-23T23:56:31.881147+0000","last_clean":"2024-03-23T23:56:31.881147+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:56:31.881147+0000","last_undegraded":"2024-03-23T23:56:31.881147+0000","last_fullsized":"2024-03-23T23:56:31.881147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:30:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880683+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:56:31.880683+0000","last_peered":"2024-03-23T23:56:31.880683+0000","last_clean":"2024-03-23T23:56:31.880683+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:56:31.880683+0000","last_undegraded":"2024-03-23T23:56:31.880683+0000","last_fullsized":"2024-03-23T23:56:31.880683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254542+0000","last_change":"2024-03-23T23:56:29.886033+0000","last_active":"2024-03-23T23:56:32.254542+0000","last_peered":"2024-03-23T23:56:32.254542+0000","last_clean":"2024-03-23T23:56:32.254542+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:56:32.254542+0000","last_undegraded":"2024-03-23T23:56:32.254542+0000","last_fullsized":"2024-03-23T23:56:32.254542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254736+0000","last_change":"2024-03-23T23:56:30.883752+0000","last_active":"2024-03-23T23:56:32.254736+0000","last_peered":"2024-03-23T23:56:32.254736+0000","last_clean":"2024-03-23T23:56:32.254736+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:56:32.254736+0000","last_undegraded":"2024-03-23T23:56:32.254736+0000","last_fullsized":"2024-03-23T23:56:32.254736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879967+0000","last_change":"2024-03-23T23:56:29.881565+0000","last_active":"2024-03-23T23:56:31.879967+0000","last_peered":"2024-03-23T23:56:31.879967+0000","last_clean":"2024-03-23T23:56:31.879967+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:56:31.879967+0000","last_undegraded":"2024-03-23T23:56:31.879967+0000","last_fullsized":"2024-03-23T23:56:31.879967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256063+0000","last_change":"2024-03-23T23:56:30.886503+0000","last_active":"2024-03-23T23:56:32.256063+0000","last_peered":"2024-03-23T23:56:32.256063+0000","last_clean":"2024-03-23T23:56:32.256063+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:56:32.256063+0000","last_undegraded":"2024-03-23T23:56:32.256063+0000","last_fullsized":"2024-03-23T23:56:32.256063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:02:03.136599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254842+0000","last_change":"2024-03-23T23:56:29.886668+0000","last_active":"2024-03-23T23:56:32.254842+0000","last_peered":"2024-03-23T23:56:32.254842+0000","last_clean":"2024-03-23T23:56:32.254842+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:56:32.254842+0000","last_undegraded":"2024-03-23T23:56:32.254842+0000","last_fullsized":"2024-03-23T23:56:32.254842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885797+0000","last_change":"2024-03-23T23:56:30.873826+0000","last_active":"2024-03-23T23:56:31.885797+0000","last_peered":"2024-03-23T23:56:31.885797+0000","last_clean":"2024-03-23T23:56:31.885797+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:56:31.885797+0000","last_undegraded":"2024-03-23T23:56:31.885797+0000","last_fullsized":"2024-03-23T23:56:31.885797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254909+0000","last_change":"2024-03-23T23:56:29.889635+0000","last_active":"2024-03-23T23:56:32.254909+0000","last_peered":"2024-03-23T23:56:32.254909+0000","last_clean":"2024-03-23T23:56:32.254909+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:56:32.254909+0000","last_undegraded":"2024-03-23T23:56:32.254909+0000","last_fullsized":"2024-03-23T23:56:32.254909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879010+0000","last_change":"2024-03-23T23:56:30.883369+0000","last_active":"2024-03-23T23:56:31.879010+0000","last_peered":"2024-03-23T23:56:31.879010+0000","last_clean":"2024-03-23T23:56:31.879010+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:56:31.879010+0000","last_undegraded":"2024-03-23T23:56:31.879010+0000","last_fullsized":"2024-03-23T23:56:31.879010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:12.049887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886128+0000","last_change":"2024-03-23T23:56:29.883626+0000","last_active":"2024-03-23T23:56:31.886128+0000","last_peered":"2024-03-23T23:56:31.886128+0000","last_clean":"2024-03-23T23:56:31.886128+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:56:31.886128+0000","last_undegraded":"2024-03-23T23:56:31.886128+0000","last_fullsized":"2024-03-23T23:56:31.886128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255652+0000","last_change":"2024-03-23T23:56:30.888942+0000","last_active":"2024-03-23T23:56:32.255652+0000","last_peered":"2024-03-23T23:56:32.255652+0000","last_clean":"2024-03-23T23:56:32.255652+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:56:32.255652+0000","last_undegraded":"2024-03-23T23:56:32.255652+0000","last_fullsized":"2024-03-23T23:56:32.255652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881316+0000","last_change":"2024-03-23T23:56:29.886058+0000","last_active":"2024-03-23T23:56:31.881316+0000","last_peered":"2024-03-23T23:56:31.881316+0000","last_clean":"2024-03-23T23:56:31.881316+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:56:31.881316+0000","last_undegraded":"2024-03-23T23:56:31.881316+0000","last_fullsized":"2024-03-23T23:56:31.881316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:16.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886086+0000","last_change":"2024-03-23T23:56:30.878188+0000","last_active":"2024-03-23T23:56:31.886086+0000","last_peered":"2024-03-23T23:56:31.886086+0000","last_clean":"2024-03-23T23:56:31.886086+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:56:31.886086+0000","last_undegraded":"2024-03-23T23:56:31.886086+0000","last_fullsized":"2024-03-23T23:56:31.886086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.889539+0000","last_change":"2024-03-23T23:56:29.884993+0000","last_active":"2024-03-23T23:56:31.889539+0000","last_peered":"2024-03-23T23:56:31.889539+0000","last_clean":"2024-03-23T23:56:31.889539+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:56:31.889539+0000","last_undegraded":"2024-03-23T23:56:31.889539+0000","last_fullsized":"2024-03-23T23:56:31.889539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258201+0000","last_change":"2024-03-23T23:56:30.896247+0000","last_active":"2024-03-23T23:56:32.258201+0000","last_peered":"2024-03-23T23:56:32.258201+0000","last_clean":"2024-03-23T23:56:32.258201+0000","last_became_active":"2024-03-23T23:56:30.895708+0000","last_became_peered":"2024-03-23T23:56:30.895708+0000","last_unstale":"2024-03-23T23:56:32.258201+0000","last_undegraded":"2024-03-23T23:56:32.258201+0000","last_fullsized":"2024-03-23T23:56:32.258201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880799+0000","last_change":"2024-03-23T23:56:29.881331+0000","last_active":"2024-03-23T23:56:31.880799+0000","last_peered":"2024-03-23T23:56:31.880799+0000","last_clean":"2024-03-23T23:56:31.880799+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:56:31.880799+0000","last_undegraded":"2024-03-23T23:56:31.880799+0000","last_fullsized":"2024-03-23T23:56:31.880799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257247+0000","last_change":"2024-03-23T23:56:30.874453+0000","last_active":"2024-03-23T23:56:32.257247+0000","last_peered":"2024-03-23T23:56:32.257247+0000","last_clean":"2024-03-23T23:56:32.257247+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:56:32.257247+0000","last_undegraded":"2024-03-23T23:56:32.257247+0000","last_fullsized":"2024-03-23T23:56:32.257247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879945+0000","last_change":"2024-03-23T23:56:29.879862+0000","last_active":"2024-03-23T23:56:31.879945+0000","last_peered":"2024-03-23T23:56:31.879945+0000","last_clean":"2024-03-23T23:56:31.879945+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:56:31.879945+0000","last_undegraded":"2024-03-23T23:56:31.879945+0000","last_fullsized":"2024-03-23T23:56:31.879945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881495+0000","last_change":"2024-03-23T23:56:30.874693+0000","last_active":"2024-03-23T23:56:31.881495+0000","last_peered":"2024-03-23T23:56:31.881495+0000","last_clean":"2024-03-23T23:56:31.881495+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:56:31.881495+0000","last_undegraded":"2024-03-23T23:56:31.881495+0000","last_fullsized":"2024-03-23T23:56:31.881495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885663+0000","last_change":"2024-03-23T23:56:29.887900+0000","last_active":"2024-03-23T23:56:31.885663+0000","last_peered":"2024-03-23T23:56:31.885663+0000","last_clean":"2024-03-23T23:56:31.885663+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:56:31.885663+0000","last_undegraded":"2024-03-23T23:56:31.885663+0000","last_fullsized":"2024-03-23T23:56:31.885663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254162+0000","last_change":"2024-03-23T23:56:30.875932+0000","last_active":"2024-03-23T23:56:32.254162+0000","last_peered":"2024-03-23T23:56:32.254162+0000","last_clean":"2024-03-23T23:56:32.254162+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:56:32.254162+0000","last_undegraded":"2024-03-23T23:56:32.254162+0000","last_fullsized":"2024-03-23T23:56:32.254162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885953+0000","last_change":"2024-03-23T23:56:29.884727+0000","last_active":"2024-03-23T23:56:31.885953+0000","last_peered":"2024-03-23T23:56:31.885953+0000","last_clean":"2024-03-23T23:56:31.885953+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:56:31.885953+0000","last_undegraded":"2024-03-23T23:56:31.885953+0000","last_fullsized":"2024-03-23T23:56:31.885953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257237+0000","last_change":"2024-03-23T23:56:30.887213+0000","last_active":"2024-03-23T23:56:32.257237+0000","last_peered":"2024-03-23T23:56:32.257237+0000","last_clean":"2024-03-23T23:56:32.257237+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:56:32.257237+0000","last_undegraded":"2024-03-23T23:56:32.257237+0000","last_fullsized":"2024-03-23T23:56:32.257237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880607+0000","last_change":"2024-03-23T23:56:29.895498+0000","last_active":"2024-03-23T23:56:31.880607+0000","last_peered":"2024-03-23T23:56:31.880607+0000","last_clean":"2024-03-23T23:56:31.880607+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:56:31.880607+0000","last_undegraded":"2024-03-23T23:56:31.880607+0000","last_fullsized":"2024-03-23T23:56:31.880607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879020+0000","last_change":"2024-03-23T23:56:30.884001+0000","last_active":"2024-03-23T23:56:31.879020+0000","last_peered":"2024-03-23T23:56:31.879020+0000","last_clean":"2024-03-23T23:56:31.879020+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:56:31.879020+0000","last_undegraded":"2024-03-23T23:56:31.879020+0000","last_fullsized":"2024-03-23T23:56:31.879020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255206+0000","last_change":"2024-03-23T23:56:30.889155+0000","last_active":"2024-03-23T23:56:32.255206+0000","last_peered":"2024-03-23T23:56:32.255206+0000","last_clean":"2024-03-23T23:56:32.255206+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:56:32.255206+0000","last_undegraded":"2024-03-23T23:56:32.255206+0000","last_fullsized":"2024-03-23T23:56:32.255206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880243+0000","last_change":"2024-03-23T23:56:29.888617+0000","last_active":"2024-03-23T23:56:31.880243+0000","last_peered":"2024-03-23T23:56:31.880243+0000","last_clean":"2024-03-23T23:56:31.880243+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:56:31.880243+0000","last_undegraded":"2024-03-23T23:56:31.880243+0000","last_fullsized":"2024-03-23T23:56:31.880243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254874+0000","last_change":"2024-03-23T23:56:30.888308+0000","last_active":"2024-03-23T23:56:32.254874+0000","last_peered":"2024-03-23T23:56:32.254874+0000","last_clean":"2024-03-23T23:56:32.254874+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:56:32.254874+0000","last_undegraded":"2024-03-23T23:56:32.254874+0000","last_fullsized":"2024-03-23T23:56:32.254874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881151+0000","last_change":"2024-03-23T23:56:29.879942+0000","last_active":"2024-03-23T23:56:31.881151+0000","last_peered":"2024-03-23T23:56:31.881151+0000","last_clean":"2024-03-23T23:56:31.881151+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:56:31.881151+0000","last_undegraded":"2024-03-23T23:56:31.881151+0000","last_fullsized":"2024-03-23T23:56:31.881151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256890+0000","last_change":"2024-03-23T23:56:30.880556+0000","last_active":"2024-03-23T23:56:32.256890+0000","last_peered":"2024-03-23T23:56:32.256890+0000","last_clean":"2024-03-23T23:56:32.256890+0000","last_became_active":"2024-03-23T23:56:30.880059+0000","last_became_peered":"2024-03-23T23:56:30.880059+0000","last_unstale":"2024-03-23T23:56:32.256890+0000","last_undegraded":"2024-03-23T23:56:32.256890+0000","last_fullsized":"2024-03-23T23:56:32.256890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258932+0000","last_change":"2024-03-23T23:56:29.889380+0000","last_active":"2024-03-23T23:56:32.258932+0000","last_peered":"2024-03-23T23:56:32.258932+0000","last_clean":"2024-03-23T23:56:32.258932+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:56:32.258932+0000","last_undegraded":"2024-03-23T23:56:32.258932+0000","last_fullsized":"2024-03-23T23:56:32.258932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258708+0000","last_change":"2024-03-23T23:56:30.885383+0000","last_active":"2024-03-23T23:56:32.258708+0000","last_peered":"2024-03-23T23:56:32.258708+0000","last_clean":"2024-03-23T23:56:32.258708+0000","last_became_active":"2024-03-23T23:56:30.885039+0000","last_became_peered":"2024-03-23T23:56:30.885039+0000","last_unstale":"2024-03-23T23:56:32.258708+0000","last_undegraded":"2024-03-23T23:56:32.258708+0000","last_fullsized":"2024-03-23T23:56:32.258708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257029+0000","last_change":"2024-03-23T23:56:29.886266+0000","last_active":"2024-03-23T23:56:32.257029+0000","last_peered":"2024-03-23T23:56:32.257029+0000","last_clean":"2024-03-23T23:56:32.257029+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:56:32.257029+0000","last_undegraded":"2024-03-23T23:56:32.257029+0000","last_fullsized":"2024-03-23T23:56:32.257029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:56:41.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:56:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.344+0000 7fc4efe00640 1 Processor -- start 2024-03-23T23:56:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.344+0000 7fc4efe00640 1 -- start start 2024-03-23T23:56:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.345+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f0142380 0x7fc4f01427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.345+0000 7fc4efe00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f00b8c90 con 0x7fc4f00b88b0 2024-03-23T23:56:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.345+0000 7fc4efe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f00b49a0 con 0x7fc4f0148950 2024-03-23T23:56:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.345+0000 7fc4efe00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00b4f60 con 0x7fc4f0142380 2024-03-23T23:56:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.346+0000 7fc4eea00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc4f00b88b0 0x7fc4f00b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59570/0 (socket says 172.21.15.31:59570) 2024-03-23T23:56:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.346+0000 7fc4eea00640 1 -- 172.21.15.31:0/718038821 learned_addr learned my addr 172.21.15.31:0/718038821 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.346+0000 7fc4ee000640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f0142380 0x7fc4f01427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.346+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088308868 0 0) 0x7fc4f00b8c90 con 0x7fc4f00b88b0 2024-03-23T23:56:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.346+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4d4003520 con 0x7fc4f00b88b0 2024-03-23T23:56:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 6028224 0 0) 0x7fc4d4003520 con 0x7fc4f00b88b0 2024-03-23T23:56:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f0142380 msgr2=0x7fc4f01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f0142380 0x7fc4f01427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 >> v1:172.21.15.59:6789/0 conn(0x7fc4f0148950 legacy=0x7fc4f0148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00b4c80 con 0x7fc4f00b88b0 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fc4e0001670 con 0x7fc4f00b88b0 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 >> v1:172.21.15.31:6789/0 conn(0x7fc4f00b88b0 legacy=0x7fc4f00b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4d4003a50 0x7fc4d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f0142380 0x7fc4d4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4d40052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00b4f60 con 0x7fc4d4004e40 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d400bd30 con 0x7fc4d4003a50 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d400bf30 con 0x7fc4f0142380 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ef400640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4d40052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4eea00640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4d4003a50 0x7fc4d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ef400640 1 -- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f0142380 msgr2=0x7fc4d4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ef400640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f0142380 0x7fc4d4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ef400640 1 -- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4d4003a50 msgr2=0x7fc4d4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.347+0000 7fc4ef400640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4d4003a50 0x7fc4d4003e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.348+0000 7fc4ef400640 1 -- 172.21.15.31:0/718038821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d4003520 con 0x7fc4d4004e40 2024-03-23T23:56:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4ef400640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4d40052c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8001e50 tx=0x7fc4d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2364a4ec3b7d17d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e8001a70 con 0x7fc4d4004e40 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e8003b70 con 0x7fc4d4004e40 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4ed600640 1 -- 172.21.15.31:0/718038821 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e80050d0 con 0x7fc4d4004e40 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4efe00640 1 -- 172.21.15.31:0/718038821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 msgr2=0x7fc4d40052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4efe00640 1 --2- 172.21.15.31:0/718038821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4d40052c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8001e50 tx=0x7fc4d4005830 comp rx=0 tx=0).stop 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4ef400640 1 -- 172.21.15.31:0/718038821 reap_dead start 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4efe00640 1 -- 172.21.15.31:0/718038821 shutdown_connections 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4efe00640 1 -- 172.21.15.31:0/718038821 >> 172.21.15.31:0/718038821 conn(0x7fc4f006cf40 msgr2=0x7fc4f006ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4efe00640 1 -- 172.21.15.31:0/718038821 shutdown_connections 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.349+0000 7fc4efe00640 1 -- 172.21.15.31:0/718038821 wait complete. 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.351+0000 7fc4efe00640 1 Processor -- start 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.351+0000 7fc4efe00640 1 -- start start 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4f00aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f009b550 0x7fc4f01dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f009ccf0 0x7fc4f01e0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4efe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00b9490 con 0x7fc4d4004e40 2024-03-23T23:56:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4efe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f01427f0 con 0x7fc4f009b550 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4efe00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f009c860 con 0x7fc4f009ccf0 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4f00aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4f00aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33094/0 (socket says 172.21.15.31:33094) 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 -- 172.21.15.31:0/2266406705 learned_addr learned my addr 172.21.15.31:0/2266406705 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 -- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f009ccf0 msgr2=0x7fc4f01e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f009ccf0 0x7fc4f01e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 -- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f009b550 msgr2=0x7fc4f01dcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f009b550 0x7fc4f01dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.352+0000 7fc4eea00640 1 -- 172.21.15.31:0/2266406705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f009c250 con 0x7fc4d4004e40 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.353+0000 7fc4eea00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4f00aef30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000d7a0 tx=0x7fc4e000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.353+0000 7fc4e6a00640 1 -- 172.21.15.31:0/2266406705 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0019070 con 0x7fc4d4004e40 2024-03-23T23:56:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.353+0000 7fc4e6a00640 1 -- 172.21.15.31:0/2266406705 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e000de50 con 0x7fc4d4004e40 2024-03-23T23:56:41.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.353+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f01440e0 con 0x7fc4d4004e40 2024-03-23T23:56:41.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.353+0000 7fc4e6a00640 1 -- 172.21.15.31:0/2266406705 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00047e0 con 0x7fc4d4004e40 2024-03-23T23:56:41.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.353+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f00b0310 con 0x7fc4d4004e40 2024-03-23T23:56:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.354+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f00752c0 con 0x7fc4d4004e40 2024-03-23T23:56:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.355+0000 7fc4e6a00640 1 -- 172.21.15.31:0/2266406705 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc4e001c070 con 0x7fc4d4004e40 2024-03-23T23:56:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.356+0000 7fc4e6a00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc4d006bbd0 0x7fc4d006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.356+0000 7fc4e6a00640 1 -- 172.21.15.31:0/2266406705 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4e008a3a0 con 0x7fc4d4004e40 2024-03-23T23:56:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.356+0000 7fc4ee000640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc4d006bbd0 0x7fc4d006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.358+0000 7fc4ee000640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc4d006bbd0 0x7fc4d006e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00af7d0 tx=0x7fc4dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.360+0000 7fc4e6a00640 1 -- 172.21.15.31:0/2266406705 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fc4e0058e80 con 0x7fc4d4004e40 2024-03-23T23:56:41.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.548+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4f0068c20 con 0x7fc4d006bbd0 2024-03-23T23:56:41.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.567+0000 7fc4e6a00640 1 -- 172.21.15.31:0/2266406705 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251837 (secure 0 0 0) 0x7fc4dc009d40 con 0x7fc4d006bbd0 2024-03-23T23:56:41.570 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:41.571 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:56:41.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc4d006bbd0 msgr2=0x7fc4d006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc4d006bbd0 0x7fc4d006e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00af7d0 tx=0x7fc4dc008040 comp rx=0 tx=0).stop 2024-03-23T23:56:41.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 msgr2=0x7fc4f00aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4f00aef30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000d7a0 tx=0x7fc4e000dc60 comp rx=0 tx=0).stop 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 shutdown_connections 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc4d006bbd0 0x7fc4d006e090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f009b550 0x7fc4f01dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4f009ccf0 0x7fc4f01e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 --2- 172.21.15.31:0/2266406705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d4004e40 0x7fc4f00aef30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.571+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 >> 172.21.15.31:0/2266406705 conn(0x7fc4f006cf40 msgr2=0x7fc4f0068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.572+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 shutdown_connections 2024-03-23T23:56:41.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.572+0000 7fc4efe00640 1 -- 172.21.15.31:0/2266406705 wait complete. 2024-03-23T23:56:41.588 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-03-23T23:56:41.322351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003707"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880786+0000","last_change":"2024-03-23T23:56:30.885878+0000","last_active":"2024-03-23T23:56:31.880786+0000","last_peered":"2024-03-23T23:56:31.880786+0000","last_clean":"2024-03-23T23:56:31.880786+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:56:31.880786+0000","last_undegraded":"2024-03-23T23:56:31.880786+0000","last_fullsized":"2024-03-23T23:56:31.880786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886363+0000","last_change":"2024-03-23T23:56:30.875303+0000","last_active":"2024-03-23T23:56:31.886363+0000","last_peered":"2024-03-23T23:56:31.886363+0000","last_clean":"2024-03-23T23:56:31.886363+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:56:31.886363+0000","last_undegraded":"2024-03-23T23:56:31.886363+0000","last_fullsized":"2024-03-23T23:56:31.886363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257583+0000","last_change":"2024-03-23T23:56:30.883893+0000","last_active":"2024-03-23T23:56:32.257583+0000","last_peered":"2024-03-23T23:56:32.257583+0000","last_clean":"2024-03-23T23:56:32.257583+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:56:32.257583+0000","last_undegraded":"2024-03-23T23:56:32.257583+0000","last_fullsized":"2024-03-23T23:56:32.257583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254511+0000","last_change":"2024-03-23T23:56:30.891008+0000","last_active":"2024-03-23T23:56:32.254511+0000","last_peered":"2024-03-23T23:56:32.254511+0000","last_clean":"2024-03-23T23:56:32.254511+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:56:32.254511+0000","last_undegraded":"2024-03-23T23:56:32.254511+0000","last_fullsized":"2024-03-23T23:56:32.254511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880448+0000","last_change":"2024-03-23T23:56:30.877242+0000","last_active":"2024-03-23T23:56:31.880448+0000","last_peered":"2024-03-23T23:56:31.880448+0000","last_clean":"2024-03-23T23:56:31.880448+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:56:31.880448+0000","last_undegraded":"2024-03-23T23:56:31.880448+0000","last_fullsized":"2024-03-23T23:56:31.880448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254330+0000","last_change":"2024-03-23T23:56:30.890268+0000","last_active":"2024-03-23T23:56:32.254330+0000","last_peered":"2024-03-23T23:56:32.254330+0000","last_clean":"2024-03-23T23:56:32.254330+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:56:32.254330+0000","last_undegraded":"2024-03-23T23:56:32.254330+0000","last_fullsized":"2024-03-23T23:56:32.254330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880096+0000","last_change":"2024-03-23T23:56:30.885059+0000","last_active":"2024-03-23T23:56:31.880096+0000","last_peered":"2024-03-23T23:56:31.880096+0000","last_clean":"2024-03-23T23:56:31.880096+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:56:31.880096+0000","last_undegraded":"2024-03-23T23:56:31.880096+0000","last_fullsized":"2024-03-23T23:56:31.880096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253729+0000","last_change":"2024-03-23T23:56:30.881077+0000","last_active":"2024-03-23T23:56:32.253729+0000","last_peered":"2024-03-23T23:56:32.253729+0000","last_clean":"2024-03-23T23:56:32.253729+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:56:32.253729+0000","last_undegraded":"2024-03-23T23:56:32.253729+0000","last_fullsized":"2024-03-23T23:56:32.253729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881033+0000","last_change":"2024-03-23T23:56:30.883587+0000","last_active":"2024-03-23T23:56:31.881033+0000","last_peered":"2024-03-23T23:56:31.881033+0000","last_clean":"2024-03-23T23:56:31.881033+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:56:31.881033+0000","last_undegraded":"2024-03-23T23:56:31.881033+0000","last_fullsized":"2024-03-23T23:56:31.881033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879573+0000","last_change":"2024-03-23T23:56:30.888454+0000","last_active":"2024-03-23T23:56:31.879573+0000","last_peered":"2024-03-23T23:56:31.879573+0000","last_clean":"2024-03-23T23:56:31.879573+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:56:31.879573+0000","last_undegraded":"2024-03-23T23:56:31.879573+0000","last_fullsized":"2024-03-23T23:56:31.879573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879166+0000","last_change":"2024-03-23T23:56:30.881125+0000","last_active":"2024-03-23T23:56:31.879166+0000","last_peered":"2024-03-23T23:56:31.879166+0000","last_clean":"2024-03-23T23:56:31.879166+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:56:31.879166+0000","last_undegraded":"2024-03-23T23:56:31.879166+0000","last_fullsized":"2024-03-23T23:56:31.879166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879683+0000","last_change":"2024-03-23T23:56:30.863287+0000","last_active":"2024-03-23T23:56:31.879683+0000","last_peered":"2024-03-23T23:56:31.879683+0000","last_clean":"2024-03-23T23:56:31.879683+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:56:31.879683+0000","last_undegraded":"2024-03-23T23:56:31.879683+0000","last_fullsized":"2024-03-23T23:56:31.879683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:00.178139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258712+0000","last_change":"2024-03-23T23:56:30.881169+0000","last_active":"2024-03-23T23:56:32.258712+0000","last_peered":"2024-03-23T23:56:32.258712+0000","last_clean":"2024-03-23T23:56:32.258712+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:56:32.258712+0000","last_undegraded":"2024-03-23T23:56:32.258712+0000","last_fullsized":"2024-03-23T23:56:32.258712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256704+0000","last_change":"2024-03-23T23:56:30.876653+0000","last_active":"2024-03-23T23:56:32.256704+0000","last_peered":"2024-03-23T23:56:32.256704+0000","last_clean":"2024-03-23T23:56:32.256704+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:56:32.256704+0000","last_undegraded":"2024-03-23T23:56:32.256704+0000","last_fullsized":"2024-03-23T23:56:32.256704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:58:31.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885707+0000","last_change":"2024-03-23T23:56:30.862687+0000","last_active":"2024-03-23T23:56:31.885707+0000","last_peered":"2024-03-23T23:56:31.885707+0000","last_clean":"2024-03-23T23:56:31.885707+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:56:31.885707+0000","last_undegraded":"2024-03-23T23:56:31.885707+0000","last_fullsized":"2024-03-23T23:56:31.885707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254454+0000","last_change":"2024-03-23T23:56:30.882976+0000","last_active":"2024-03-23T23:56:32.254454+0000","last_peered":"2024-03-23T23:56:32.254454+0000","last_clean":"2024-03-23T23:56:32.254454+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:56:32.254454+0000","last_undegraded":"2024-03-23T23:56:32.254454+0000","last_fullsized":"2024-03-23T23:56:32.254454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256051+0000","last_change":"2024-03-23T23:56:30.895060+0000","last_active":"2024-03-23T23:56:32.256051+0000","last_peered":"2024-03-23T23:56:32.256051+0000","last_clean":"2024-03-23T23:56:32.256051+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:56:32.256051+0000","last_undegraded":"2024-03-23T23:56:32.256051+0000","last_fullsized":"2024-03-23T23:56:32.256051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255325+0000","last_change":"2024-03-23T23:56:30.892332+0000","last_active":"2024-03-23T23:56:32.255325+0000","last_peered":"2024-03-23T23:56:32.255325+0000","last_clean":"2024-03-23T23:56:32.255325+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:56:32.255325+0000","last_undegraded":"2024-03-23T23:56:32.255325+0000","last_fullsized":"2024-03-23T23:56:32.255325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881381+0000","last_change":"2024-03-23T23:56:30.881290+0000","last_active":"2024-03-23T23:56:31.881381+0000","last_peered":"2024-03-23T23:56:31.881381+0000","last_clean":"2024-03-23T23:56:31.881381+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:56:31.881381+0000","last_undegraded":"2024-03-23T23:56:31.881381+0000","last_fullsized":"2024-03-23T23:56:31.881381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:54:18.265054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879417+0000","last_change":"2024-03-23T23:56:30.875425+0000","last_active":"2024-03-23T23:56:31.879417+0000","last_peered":"2024-03-23T23:56:31.879417+0000","last_clean":"2024-03-23T23:56:31.879417+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:56:31.879417+0000","last_undegraded":"2024-03-23T23:56:31.879417+0000","last_fullsized":"2024-03-23T23:56:31.879417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257198+0000","last_change":"2024-03-23T23:56:30.884434+0000","last_active":"2024-03-23T23:56:32.257198+0000","last_peered":"2024-03-23T23:56:32.257198+0000","last_clean":"2024-03-23T23:56:32.257198+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:56:32.257198+0000","last_undegraded":"2024-03-23T23:56:32.257198+0000","last_fullsized":"2024-03-23T23:56:32.257198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254512+0000","last_change":"2024-03-23T23:56:30.892649+0000","last_active":"2024-03-23T23:56:32.254512+0000","last_peered":"2024-03-23T23:56:32.254512+0000","last_clean":"2024-03-23T23:56:32.254512+0000","last_became_active":"2024-03-23T23:56:30.891572+0000","last_became_peered":"2024-03-23T23:56:30.891572+0000","last_unstale":"2024-03-23T23:56:32.254512+0000","last_undegraded":"2024-03-23T23:56:32.254512+0000","last_fullsized":"2024-03-23T23:56:32.254512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253862+0000","last_change":"2024-03-23T23:56:30.888046+0000","last_active":"2024-03-23T23:56:32.253862+0000","last_peered":"2024-03-23T23:56:32.253862+0000","last_clean":"2024-03-23T23:56:32.253862+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:56:32.253862+0000","last_undegraded":"2024-03-23T23:56:32.253862+0000","last_fullsized":"2024-03-23T23:56:32.253862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254485+0000","last_change":"2024-03-23T23:56:30.886470+0000","last_active":"2024-03-23T23:56:32.254485+0000","last_peered":"2024-03-23T23:56:32.254485+0000","last_clean":"2024-03-23T23:56:32.254485+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:56:32.254485+0000","last_undegraded":"2024-03-23T23:56:32.254485+0000","last_fullsized":"2024-03-23T23:56:32.254485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257949+0000","last_change":"2024-03-23T23:56:30.885446+0000","last_active":"2024-03-23T23:56:32.257949+0000","last_peered":"2024-03-23T23:56:32.257949+0000","last_clean":"2024-03-23T23:56:32.257949+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:56:32.257949+0000","last_undegraded":"2024-03-23T23:56:32.257949+0000","last_fullsized":"2024-03-23T23:56:32.257949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879747+0000","last_change":"2024-03-23T23:56:30.882609+0000","last_active":"2024-03-23T23:56:31.879747+0000","last_peered":"2024-03-23T23:56:31.879747+0000","last_clean":"2024-03-23T23:56:31.879747+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:56:31.879747+0000","last_undegraded":"2024-03-23T23:56:31.879747+0000","last_fullsized":"2024-03-23T23:56:31.879747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886361+0000","last_change":"2024-03-23T23:56:30.881031+0000","last_active":"2024-03-23T23:56:31.886361+0000","last_peered":"2024-03-23T23:56:31.886361+0000","last_clean":"2024-03-23T23:56:31.886361+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:56:31.886361+0000","last_undegraded":"2024-03-23T23:56:31.886361+0000","last_fullsized":"2024-03-23T23:56:31.886361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258083+0000","last_change":"2024-03-23T23:56:30.887942+0000","last_active":"2024-03-23T23:56:32.258083+0000","last_peered":"2024-03-23T23:56:32.258083+0000","last_clean":"2024-03-23T23:56:32.258083+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:56:32.258083+0000","last_undegraded":"2024-03-23T23:56:32.258083+0000","last_fullsized":"2024-03-23T23:56:32.258083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257607+0000","last_change":"2024-03-23T23:56:30.882527+0000","last_active":"2024-03-23T23:56:32.257607+0000","last_peered":"2024-03-23T23:56:32.257607+0000","last_clean":"2024-03-23T23:56:32.257607+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:56:32.257607+0000","last_undegraded":"2024-03-23T23:56:32.257607+0000","last_fullsized":"2024-03-23T23:56:32.257607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254651+0000","last_change":"2024-03-23T23:56:30.885451+0000","last_active":"2024-03-23T23:56:32.254651+0000","last_peered":"2024-03-23T23:56:32.254651+0000","last_clean":"2024-03-23T23:56:32.254651+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:56:32.254651+0000","last_undegraded":"2024-03-23T23:56:32.254651+0000","last_fullsized":"2024-03-23T23:56:32.254651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255346+0000","last_change":"2024-03-23T23:56:30.880152+0000","last_active":"2024-03-23T23:56:32.255346+0000","last_peered":"2024-03-23T23:56:32.255346+0000","last_clean":"2024-03-23T23:56:32.255346+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:56:32.255346+0000","last_undegraded":"2024-03-23T23:56:32.255346+0000","last_fullsized":"2024-03-23T23:56:32.255346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:17.288541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.878895+0000","last_change":"2024-03-23T23:56:30.880378+0000","last_active":"2024-03-23T23:56:31.878895+0000","last_peered":"2024-03-23T23:56:31.878895+0000","last_clean":"2024-03-23T23:56:31.878895+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:56:31.878895+0000","last_undegraded":"2024-03-23T23:56:31.878895+0000","last_fullsized":"2024-03-23T23:56:31.878895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879226+0000","last_change":"2024-03-23T23:56:30.869148+0000","last_active":"2024-03-23T23:56:31.879226+0000","last_peered":"2024-03-23T23:56:31.879226+0000","last_clean":"2024-03-23T23:56:31.879226+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:56:31.879226+0000","last_undegraded":"2024-03-23T23:56:31.879226+0000","last_fullsized":"2024-03-23T23:56:31.879226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:38.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257347+0000","last_change":"2024-03-23T23:56:29.890549+0000","last_active":"2024-03-23T23:56:32.257347+0000","last_peered":"2024-03-23T23:56:32.257347+0000","last_clean":"2024-03-23T23:56:32.257347+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:56:32.257347+0000","last_undegraded":"2024-03-23T23:56:32.257347+0000","last_fullsized":"2024-03-23T23:56:32.257347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257985+0000","last_change":"2024-03-23T23:56:30.885979+0000","last_active":"2024-03-23T23:56:32.257985+0000","last_peered":"2024-03-23T23:56:32.257985+0000","last_clean":"2024-03-23T23:56:32.257985+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:56:32.257985+0000","last_undegraded":"2024-03-23T23:56:32.257985+0000","last_fullsized":"2024-03-23T23:56:32.257985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879119+0000","last_change":"2024-03-23T23:56:29.892444+0000","last_active":"2024-03-23T23:56:31.879119+0000","last_peered":"2024-03-23T23:56:31.879119+0000","last_clean":"2024-03-23T23:56:31.879119+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:56:31.879119+0000","last_undegraded":"2024-03-23T23:56:31.879119+0000","last_fullsized":"2024-03-23T23:56:31.879119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254322+0000","last_change":"2024-03-23T23:56:29.887065+0000","last_active":"2024-03-23T23:56:32.254322+0000","last_peered":"2024-03-23T23:56:32.254322+0000","last_clean":"2024-03-23T23:56:32.254322+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:56:32.254322+0000","last_undegraded":"2024-03-23T23:56:32.254322+0000","last_fullsized":"2024-03-23T23:56:32.254322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:05:45.290286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.253905+0000","last_change":"2024-03-23T23:56:30.881409+0000","last_active":"2024-03-23T23:56:32.253905+0000","last_peered":"2024-03-23T23:56:32.253905+0000","last_clean":"2024-03-23T23:56:32.253905+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:56:32.253905+0000","last_undegraded":"2024-03-23T23:56:32.253905+0000","last_fullsized":"2024-03-23T23:56:32.253905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254835+0000","last_change":"2024-03-23T23:56:29.897340+0000","last_active":"2024-03-23T23:56:32.254835+0000","last_peered":"2024-03-23T23:56:32.254835+0000","last_clean":"2024-03-23T23:56:32.254835+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:56:32.254835+0000","last_undegraded":"2024-03-23T23:56:32.254835+0000","last_fullsized":"2024-03-23T23:56:32.254835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885515+0000","last_change":"2024-03-23T23:56:30.876574+0000","last_active":"2024-03-23T23:56:31.885515+0000","last_peered":"2024-03-23T23:56:31.885515+0000","last_clean":"2024-03-23T23:56:31.885515+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:56:31.885515+0000","last_undegraded":"2024-03-23T23:56:31.885515+0000","last_fullsized":"2024-03-23T23:56:31.885515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880683+0000","last_change":"2024-03-23T23:56:29.894494+0000","last_active":"2024-03-23T23:56:31.880683+0000","last_peered":"2024-03-23T23:56:31.880683+0000","last_clean":"2024-03-23T23:56:31.880683+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:56:31.880683+0000","last_undegraded":"2024-03-23T23:56:31.880683+0000","last_fullsized":"2024-03-23T23:56:31.880683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255328+0000","last_change":"2024-03-23T23:56:30.891335+0000","last_active":"2024-03-23T23:56:32.255328+0000","last_peered":"2024-03-23T23:56:32.255328+0000","last_clean":"2024-03-23T23:56:32.255328+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:56:32.255328+0000","last_undegraded":"2024-03-23T23:56:32.255328+0000","last_fullsized":"2024-03-23T23:56:32.255328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255238+0000","last_change":"2024-03-23T23:56:29.886369+0000","last_active":"2024-03-23T23:56:32.255238+0000","last_peered":"2024-03-23T23:56:32.255238+0000","last_clean":"2024-03-23T23:56:32.255238+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:56:32.255238+0000","last_undegraded":"2024-03-23T23:56:32.255238+0000","last_fullsized":"2024-03-23T23:56:32.255238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257122+0000","last_change":"2024-03-23T23:56:30.876882+0000","last_active":"2024-03-23T23:56:32.257122+0000","last_peered":"2024-03-23T23:56:32.257122+0000","last_clean":"2024-03-23T23:56:32.257122+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:56:32.257122+0000","last_undegraded":"2024-03-23T23:56:32.257122+0000","last_fullsized":"2024-03-23T23:56:32.257122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886446+0000","last_change":"2024-03-23T23:56:29.886611+0000","last_active":"2024-03-23T23:56:31.886446+0000","last_peered":"2024-03-23T23:56:31.886446+0000","last_clean":"2024-03-23T23:56:31.886446+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:56:31.886446+0000","last_undegraded":"2024-03-23T23:56:31.886446+0000","last_fullsized":"2024-03-23T23:56:31.886446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879896+0000","last_change":"2024-03-23T23:56:30.871258+0000","last_active":"2024-03-23T23:56:31.879896+0000","last_peered":"2024-03-23T23:56:31.879896+0000","last_clean":"2024-03-23T23:56:31.879896+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:56:31.879896+0000","last_undegraded":"2024-03-23T23:56:31.879896+0000","last_fullsized":"2024-03-23T23:56:31.879896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:12.879233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879697+0000","last_change":"2024-03-23T23:56:29.886316+0000","last_active":"2024-03-23T23:56:31.879697+0000","last_peered":"2024-03-23T23:56:31.879697+0000","last_clean":"2024-03-23T23:56:31.879697+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:56:31.879697+0000","last_undegraded":"2024-03-23T23:56:31.879697+0000","last_fullsized":"2024-03-23T23:56:31.879697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880255+0000","last_change":"2024-03-23T23:56:30.885592+0000","last_active":"2024-03-23T23:56:31.880255+0000","last_peered":"2024-03-23T23:56:31.880255+0000","last_clean":"2024-03-23T23:56:31.880255+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:56:31.880255+0000","last_undegraded":"2024-03-23T23:56:31.880255+0000","last_fullsized":"2024-03-23T23:56:31.880255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258275+0000","last_change":"2024-03-23T23:56:29.891265+0000","last_active":"2024-03-23T23:56:32.258275+0000","last_peered":"2024-03-23T23:56:32.258275+0000","last_clean":"2024-03-23T23:56:32.258275+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:56:32.258275+0000","last_undegraded":"2024-03-23T23:56:32.258275+0000","last_fullsized":"2024-03-23T23:56:32.258275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:53.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258434+0000","last_change":"2024-03-23T23:56:30.886240+0000","last_active":"2024-03-23T23:56:32.258434+0000","last_peered":"2024-03-23T23:56:32.258434+0000","last_clean":"2024-03-23T23:56:32.258434+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:56:32.258434+0000","last_undegraded":"2024-03-23T23:56:32.258434+0000","last_fullsized":"2024-03-23T23:56:32.258434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254833+0000","last_change":"2024-03-23T23:56:29.890485+0000","last_active":"2024-03-23T23:56:32.254833+0000","last_peered":"2024-03-23T23:56:32.254833+0000","last_clean":"2024-03-23T23:56:32.254833+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:56:32.254833+0000","last_undegraded":"2024-03-23T23:56:32.254833+0000","last_fullsized":"2024-03-23T23:56:32.254833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880483+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:56:31.880483+0000","last_peered":"2024-03-23T23:56:31.880483+0000","last_clean":"2024-03-23T23:56:31.880483+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:56:31.880483+0000","last_undegraded":"2024-03-23T23:56:31.880483+0000","last_fullsized":"2024-03-23T23:56:31.880483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879506+0000","last_change":"2024-03-23T23:56:29.896833+0000","last_active":"2024-03-23T23:56:31.879506+0000","last_peered":"2024-03-23T23:56:31.879506+0000","last_clean":"2024-03-23T23:56:31.879506+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:56:31.879506+0000","last_undegraded":"2024-03-23T23:56:31.879506+0000","last_fullsized":"2024-03-23T23:56:31.879506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879148+0000","last_change":"2024-03-23T23:56:30.876178+0000","last_active":"2024-03-23T23:56:31.879148+0000","last_peered":"2024-03-23T23:56:31.879148+0000","last_clean":"2024-03-23T23:56:31.879148+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:56:31.879148+0000","last_undegraded":"2024-03-23T23:56:31.879148+0000","last_fullsized":"2024-03-23T23:56:31.879148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255878+0000","last_change":"2024-03-23T23:56:29.879437+0000","last_active":"2024-03-23T23:56:32.255878+0000","last_peered":"2024-03-23T23:56:32.255878+0000","last_clean":"2024-03-23T23:56:32.255878+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:56:32.255878+0000","last_undegraded":"2024-03-23T23:56:32.255878+0000","last_fullsized":"2024-03-23T23:56:32.255878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880229+0000","last_change":"2024-03-23T23:56:30.888310+0000","last_active":"2024-03-23T23:56:31.880229+0000","last_peered":"2024-03-23T23:56:31.880229+0000","last_clean":"2024-03-23T23:56:31.880229+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:56:31.880229+0000","last_undegraded":"2024-03-23T23:56:31.880229+0000","last_fullsized":"2024-03-23T23:56:31.880229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881660+0000","last_change":"2024-03-23T23:56:29.892548+0000","last_active":"2024-03-23T23:56:31.881660+0000","last_peered":"2024-03-23T23:56:31.881660+0000","last_clean":"2024-03-23T23:56:31.881660+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:56:31.881660+0000","last_undegraded":"2024-03-23T23:56:31.881660+0000","last_fullsized":"2024-03-23T23:56:31.881660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:53:30.285127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880515+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:56:31.880515+0000","last_peered":"2024-03-23T23:56:31.880515+0000","last_clean":"2024-03-23T23:56:31.880515+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:56:31.880515+0000","last_undegraded":"2024-03-23T23:56:31.880515+0000","last_fullsized":"2024-03-23T23:56:31.880515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255780+0000","last_change":"2024-03-23T23:56:29.883486+0000","last_active":"2024-03-23T23:56:32.255780+0000","last_peered":"2024-03-23T23:56:32.255780+0000","last_clean":"2024-03-23T23:56:32.255780+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:56:32.255780+0000","last_undegraded":"2024-03-23T23:56:32.255780+0000","last_fullsized":"2024-03-23T23:56:32.255780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881016+0000","last_change":"2024-03-23T23:56:30.887560+0000","last_active":"2024-03-23T23:56:31.881016+0000","last_peered":"2024-03-23T23:56:31.881016+0000","last_clean":"2024-03-23T23:56:31.881016+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:56:31.881016+0000","last_undegraded":"2024-03-23T23:56:31.881016+0000","last_fullsized":"2024-03-23T23:56:31.881016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886628+0000","last_change":"2024-03-23T23:56:29.897890+0000","last_active":"2024-03-23T23:56:31.886628+0000","last_peered":"2024-03-23T23:56:31.886628+0000","last_clean":"2024-03-23T23:56:31.886628+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:56:31.886628+0000","last_undegraded":"2024-03-23T23:56:31.886628+0000","last_fullsized":"2024-03-23T23:56:31.886628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255074+0000","last_change":"2024-03-23T23:56:30.888006+0000","last_active":"2024-03-23T23:56:32.255074+0000","last_peered":"2024-03-23T23:56:32.255074+0000","last_clean":"2024-03-23T23:56:32.255074+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:56:32.255074+0000","last_undegraded":"2024-03-23T23:56:32.255074+0000","last_fullsized":"2024-03-23T23:56:32.255074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254929+0000","last_change":"2024-03-23T23:56:29.888464+0000","last_active":"2024-03-23T23:56:32.254929+0000","last_peered":"2024-03-23T23:56:32.254929+0000","last_clean":"2024-03-23T23:56:32.254929+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:56:32.254929+0000","last_undegraded":"2024-03-23T23:56:32.254929+0000","last_fullsized":"2024-03-23T23:56:32.254929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881147+0000","last_change":"2024-03-23T23:56:30.883536+0000","last_active":"2024-03-23T23:56:31.881147+0000","last_peered":"2024-03-23T23:56:31.881147+0000","last_clean":"2024-03-23T23:56:31.881147+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:56:31.881147+0000","last_undegraded":"2024-03-23T23:56:31.881147+0000","last_fullsized":"2024-03-23T23:56:31.881147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:30:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880683+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:56:31.880683+0000","last_peered":"2024-03-23T23:56:31.880683+0000","last_clean":"2024-03-23T23:56:31.880683+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:56:31.880683+0000","last_undegraded":"2024-03-23T23:56:31.880683+0000","last_fullsized":"2024-03-23T23:56:31.880683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254542+0000","last_change":"2024-03-23T23:56:29.886033+0000","last_active":"2024-03-23T23:56:32.254542+0000","last_peered":"2024-03-23T23:56:32.254542+0000","last_clean":"2024-03-23T23:56:32.254542+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:56:32.254542+0000","last_undegraded":"2024-03-23T23:56:32.254542+0000","last_fullsized":"2024-03-23T23:56:32.254542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254736+0000","last_change":"2024-03-23T23:56:30.883752+0000","last_active":"2024-03-23T23:56:32.254736+0000","last_peered":"2024-03-23T23:56:32.254736+0000","last_clean":"2024-03-23T23:56:32.254736+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:56:32.254736+0000","last_undegraded":"2024-03-23T23:56:32.254736+0000","last_fullsized":"2024-03-23T23:56:32.254736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879967+0000","last_change":"2024-03-23T23:56:29.881565+0000","last_active":"2024-03-23T23:56:31.879967+0000","last_peered":"2024-03-23T23:56:31.879967+0000","last_clean":"2024-03-23T23:56:31.879967+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:56:31.879967+0000","last_undegraded":"2024-03-23T23:56:31.879967+0000","last_fullsized":"2024-03-23T23:56:31.879967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256063+0000","last_change":"2024-03-23T23:56:30.886503+0000","last_active":"2024-03-23T23:56:32.256063+0000","last_peered":"2024-03-23T23:56:32.256063+0000","last_clean":"2024-03-23T23:56:32.256063+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:56:32.256063+0000","last_undegraded":"2024-03-23T23:56:32.256063+0000","last_fullsized":"2024-03-23T23:56:32.256063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:02:03.136599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254842+0000","last_change":"2024-03-23T23:56:29.886668+0000","last_active":"2024-03-23T23:56:32.254842+0000","last_peered":"2024-03-23T23:56:32.254842+0000","last_clean":"2024-03-23T23:56:32.254842+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:56:32.254842+0000","last_undegraded":"2024-03-23T23:56:32.254842+0000","last_fullsized":"2024-03-23T23:56:32.254842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885797+0000","last_change":"2024-03-23T23:56:30.873826+0000","last_active":"2024-03-23T23:56:31.885797+0000","last_peered":"2024-03-23T23:56:31.885797+0000","last_clean":"2024-03-23T23:56:31.885797+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:56:31.885797+0000","last_undegraded":"2024-03-23T23:56:31.885797+0000","last_fullsized":"2024-03-23T23:56:31.885797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254909+0000","last_change":"2024-03-23T23:56:29.889635+0000","last_active":"2024-03-23T23:56:32.254909+0000","last_peered":"2024-03-23T23:56:32.254909+0000","last_clean":"2024-03-23T23:56:32.254909+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:56:32.254909+0000","last_undegraded":"2024-03-23T23:56:32.254909+0000","last_fullsized":"2024-03-23T23:56:32.254909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879010+0000","last_change":"2024-03-23T23:56:30.883369+0000","last_active":"2024-03-23T23:56:31.879010+0000","last_peered":"2024-03-23T23:56:31.879010+0000","last_clean":"2024-03-23T23:56:31.879010+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:56:31.879010+0000","last_undegraded":"2024-03-23T23:56:31.879010+0000","last_fullsized":"2024-03-23T23:56:31.879010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:12.049887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886128+0000","last_change":"2024-03-23T23:56:29.883626+0000","last_active":"2024-03-23T23:56:31.886128+0000","last_peered":"2024-03-23T23:56:31.886128+0000","last_clean":"2024-03-23T23:56:31.886128+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:56:31.886128+0000","last_undegraded":"2024-03-23T23:56:31.886128+0000","last_fullsized":"2024-03-23T23:56:31.886128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255652+0000","last_change":"2024-03-23T23:56:30.888942+0000","last_active":"2024-03-23T23:56:32.255652+0000","last_peered":"2024-03-23T23:56:32.255652+0000","last_clean":"2024-03-23T23:56:32.255652+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:56:32.255652+0000","last_undegraded":"2024-03-23T23:56:32.255652+0000","last_fullsized":"2024-03-23T23:56:32.255652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881316+0000","last_change":"2024-03-23T23:56:29.886058+0000","last_active":"2024-03-23T23:56:31.881316+0000","last_peered":"2024-03-23T23:56:31.881316+0000","last_clean":"2024-03-23T23:56:31.881316+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:56:31.881316+0000","last_undegraded":"2024-03-23T23:56:31.881316+0000","last_fullsized":"2024-03-23T23:56:31.881316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:16.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.886086+0000","last_change":"2024-03-23T23:56:30.878188+0000","last_active":"2024-03-23T23:56:31.886086+0000","last_peered":"2024-03-23T23:56:31.886086+0000","last_clean":"2024-03-23T23:56:31.886086+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:56:31.886086+0000","last_undegraded":"2024-03-23T23:56:31.886086+0000","last_fullsized":"2024-03-23T23:56:31.886086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.889539+0000","last_change":"2024-03-23T23:56:29.884993+0000","last_active":"2024-03-23T23:56:31.889539+0000","last_peered":"2024-03-23T23:56:31.889539+0000","last_clean":"2024-03-23T23:56:31.889539+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:56:31.889539+0000","last_undegraded":"2024-03-23T23:56:31.889539+0000","last_fullsized":"2024-03-23T23:56:31.889539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258201+0000","last_change":"2024-03-23T23:56:30.896247+0000","last_active":"2024-03-23T23:56:32.258201+0000","last_peered":"2024-03-23T23:56:32.258201+0000","last_clean":"2024-03-23T23:56:32.258201+0000","last_became_active":"2024-03-23T23:56:30.895708+0000","last_became_peered":"2024-03-23T23:56:30.895708+0000","last_unstale":"2024-03-23T23:56:32.258201+0000","last_undegraded":"2024-03-23T23:56:32.258201+0000","last_fullsized":"2024-03-23T23:56:32.258201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880799+0000","last_change":"2024-03-23T23:56:29.881331+0000","last_active":"2024-03-23T23:56:31.880799+0000","last_peered":"2024-03-23T23:56:31.880799+0000","last_clean":"2024-03-23T23:56:31.880799+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:56:31.880799+0000","last_undegraded":"2024-03-23T23:56:31.880799+0000","last_fullsized":"2024-03-23T23:56:31.880799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257247+0000","last_change":"2024-03-23T23:56:30.874453+0000","last_active":"2024-03-23T23:56:32.257247+0000","last_peered":"2024-03-23T23:56:32.257247+0000","last_clean":"2024-03-23T23:56:32.257247+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:56:32.257247+0000","last_undegraded":"2024-03-23T23:56:32.257247+0000","last_fullsized":"2024-03-23T23:56:32.257247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879945+0000","last_change":"2024-03-23T23:56:29.879862+0000","last_active":"2024-03-23T23:56:31.879945+0000","last_peered":"2024-03-23T23:56:31.879945+0000","last_clean":"2024-03-23T23:56:31.879945+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:56:31.879945+0000","last_undegraded":"2024-03-23T23:56:31.879945+0000","last_fullsized":"2024-03-23T23:56:31.879945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881495+0000","last_change":"2024-03-23T23:56:30.874693+0000","last_active":"2024-03-23T23:56:31.881495+0000","last_peered":"2024-03-23T23:56:31.881495+0000","last_clean":"2024-03-23T23:56:31.881495+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:56:31.881495+0000","last_undegraded":"2024-03-23T23:56:31.881495+0000","last_fullsized":"2024-03-23T23:56:31.881495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885663+0000","last_change":"2024-03-23T23:56:29.887900+0000","last_active":"2024-03-23T23:56:31.885663+0000","last_peered":"2024-03-23T23:56:31.885663+0000","last_clean":"2024-03-23T23:56:31.885663+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:56:31.885663+0000","last_undegraded":"2024-03-23T23:56:31.885663+0000","last_fullsized":"2024-03-23T23:56:31.885663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254162+0000","last_change":"2024-03-23T23:56:30.875932+0000","last_active":"2024-03-23T23:56:32.254162+0000","last_peered":"2024-03-23T23:56:32.254162+0000","last_clean":"2024-03-23T23:56:32.254162+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:56:32.254162+0000","last_undegraded":"2024-03-23T23:56:32.254162+0000","last_fullsized":"2024-03-23T23:56:32.254162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.885953+0000","last_change":"2024-03-23T23:56:29.884727+0000","last_active":"2024-03-23T23:56:31.885953+0000","last_peered":"2024-03-23T23:56:31.885953+0000","last_clean":"2024-03-23T23:56:31.885953+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:56:31.885953+0000","last_undegraded":"2024-03-23T23:56:31.885953+0000","last_fullsized":"2024-03-23T23:56:31.885953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257237+0000","last_change":"2024-03-23T23:56:30.887213+0000","last_active":"2024-03-23T23:56:32.257237+0000","last_peered":"2024-03-23T23:56:32.257237+0000","last_clean":"2024-03-23T23:56:32.257237+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:56:32.257237+0000","last_undegraded":"2024-03-23T23:56:32.257237+0000","last_fullsized":"2024-03-23T23:56:32.257237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880607+0000","last_change":"2024-03-23T23:56:29.895498+0000","last_active":"2024-03-23T23:56:31.880607+0000","last_peered":"2024-03-23T23:56:31.880607+0000","last_clean":"2024-03-23T23:56:31.880607+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:56:31.880607+0000","last_undegraded":"2024-03-23T23:56:31.880607+0000","last_fullsized":"2024-03-23T23:56:31.880607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.879020+0000","last_change":"2024-03-23T23:56:30.884001+0000","last_active":"2024-03-23T23:56:31.879020+0000","last_peered":"2024-03-23T23:56:31.879020+0000","last_clean":"2024-03-23T23:56:31.879020+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:56:31.879020+0000","last_undegraded":"2024-03-23T23:56:31.879020+0000","last_fullsized":"2024-03-23T23:56:31.879020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.255206+0000","last_change":"2024-03-23T23:56:30.889155+0000","last_active":"2024-03-23T23:56:32.255206+0000","last_peered":"2024-03-23T23:56:32.255206+0000","last_clean":"2024-03-23T23:56:32.255206+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:56:32.255206+0000","last_undegraded":"2024-03-23T23:56:32.255206+0000","last_fullsized":"2024-03-23T23:56:32.255206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.880243+0000","last_change":"2024-03-23T23:56:29.888617+0000","last_active":"2024-03-23T23:56:31.880243+0000","last_peered":"2024-03-23T23:56:31.880243+0000","last_clean":"2024-03-23T23:56:31.880243+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:56:31.880243+0000","last_undegraded":"2024-03-23T23:56:31.880243+0000","last_fullsized":"2024-03-23T23:56:31.880243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.254874+0000","last_change":"2024-03-23T23:56:30.888308+0000","last_active":"2024-03-23T23:56:32.254874+0000","last_peered":"2024-03-23T23:56:32.254874+0000","last_clean":"2024-03-23T23:56:32.254874+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:56:32.254874+0000","last_undegraded":"2024-03-23T23:56:32.254874+0000","last_fullsized":"2024-03-23T23:56:32.254874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:31.881151+0000","last_change":"2024-03-23T23:56:29.879942+0000","last_active":"2024-03-23T23:56:31.881151+0000","last_peered":"2024-03-23T23:56:31.881151+0000","last_clean":"2024-03-23T23:56:31.881151+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:56:31.881151+0000","last_undegraded":"2024-03-23T23:56:31.881151+0000","last_fullsized":"2024-03-23T23:56:31.881151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.256890+0000","last_change":"2024-03-23T23:56:30.880556+0000","last_active":"2024-03-23T23:56:32.256890+0000","last_peered":"2024-03-23T23:56:32.256890+0000","last_clean":"2024-03-23T23:56:32.256890+0000","last_became_active":"2024-03-23T23:56:30.880059+0000","last_became_peered":"2024-03-23T23:56:30.880059+0000","last_unstale":"2024-03-23T23:56:32.256890+0000","last_undegraded":"2024-03-23T23:56:32.256890+0000","last_fullsized":"2024-03-23T23:56:32.256890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258932+0000","last_change":"2024-03-23T23:56:29.889380+0000","last_active":"2024-03-23T23:56:32.258932+0000","last_peered":"2024-03-23T23:56:32.258932+0000","last_clean":"2024-03-23T23:56:32.258932+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:56:32.258932+0000","last_undegraded":"2024-03-23T23:56:32.258932+0000","last_fullsized":"2024-03-23T23:56:32.258932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.258708+0000","last_change":"2024-03-23T23:56:30.885383+0000","last_active":"2024-03-23T23:56:32.258708+0000","last_peered":"2024-03-23T23:56:32.258708+0000","last_clean":"2024-03-23T23:56:32.258708+0000","last_became_active":"2024-03-23T23:56:30.885039+0000","last_became_peered":"2024-03-23T23:56:30.885039+0000","last_unstale":"2024-03-23T23:56:32.258708+0000","last_undegraded":"2024-03-23T23:56:32.258708+0000","last_fullsized":"2024-03-23T23:56:32.258708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-23T23:56:32.257029+0000","last_change":"2024-03-23T23:56:29.886266+0000","last_active":"2024-03-23T23:56:32.257029+0000","last_peered":"2024-03-23T23:56:32.257029+0000","last_clean":"2024-03-23T23:56:32.257029+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:56:32.257029+0000","last_undegraded":"2024-03-23T23:56:32.257029+0000","last_fullsized":"2024-03-23T23:56:32.257029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:56:41.593 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-23T23:56:41.593 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-23T23:56:41.593 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-23T23:56:41.593 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-23T23:56:41.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.849+0000 7f7f70e00640 1 Processor -- start 2024-03-23T23:56:41.849 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.850+0000 7f7f70e00640 1 -- start start 2024-03-23T23:56:41.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f70e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f6c0adaa0 0x7f7f6c0b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f70e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f6c09e0c0 0x7f7f6c143b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f70e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c0b5f90 con 0x7f7f6c0b5bb0 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f70e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0ad6b0 con 0x7f7f6c09e0c0 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f70e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c0adf30 con 0x7f7f6c0adaa0 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f6be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f6c09e0c0 0x7f7f6c143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f6be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7f6c09e0c0 0x7f7f6c143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33096/0 (socket says 172.21.15.31:33096) 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f6be00640 1 -- 172.21.15.31:0/3373168380 learned_addr learned my addr 172.21.15.31:0/3373168380 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f63e00640 1 --2- 172.21.15.31:0/3373168380 >> v2:172.21.15.59:3300/0 conn(0x7f7f6c0adaa0 0x7f7f6c0b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f6be00640 1 -- 172.21.15.31:0/3373168380 >> v2:172.21.15.59:3300/0 conn(0x7f7f6c0adaa0 msgr2=0x7f7f6c0b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f6be00640 1 --2- 172.21.15.31:0/3373168380 >> v2:172.21.15.59:3300/0 conn(0x7f7f6c0adaa0 0x7f7f6c0b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f6be00640 1 -- 172.21.15.31:0/3373168380 >> v1:172.21.15.59:6789/0 conn(0x7f7f6c0b5bb0 legacy=0x7f7f6c09d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f6be00640 1 -- 172.21.15.31:0/3373168380 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0ae210 con 0x7f7f6c09e0c0 2024-03-23T23:56:41.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.851+0000 7f7f63e00640 1 --2- 172.21.15.31:0/3373168380 >> v2:172.21.15.59:3300/0 conn(0x7f7f6c0adaa0 0x7f7f6c0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:41.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f6be00640 1 --2- 172.21.15.31:0/3373168380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09e0c0 0x7f7f6c143b90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c06c9b0 tx=0x7f7f6402e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7461efb6c1fbaf86 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:41.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f6aa00640 1 -- 172.21.15.31:0/3373168380 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64034070 con 0x7f7f6c09e0c0 2024-03-23T23:56:41.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f6aa00640 1 -- 172.21.15.31:0/3373168380 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6402ee10 con 0x7f7f6c09e0c0 2024-03-23T23:56:41.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f6aa00640 1 -- 172.21.15.31:0/3373168380 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64038620 con 0x7f7f6c09e0c0 2024-03-23T23:56:41.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f70e00640 1 -- 172.21.15.31:0/3373168380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09e0c0 msgr2=0x7f7f6c143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f70e00640 1 --2- 172.21.15.31:0/3373168380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09e0c0 0x7f7f6c143b90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c06c9b0 tx=0x7f7f6402e060 comp rx=0 tx=0).stop 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f70e00640 1 -- 172.21.15.31:0/3373168380 shutdown_connections 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f70e00640 1 --2- 172.21.15.31:0/3373168380 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09e0c0 0x7f7f6c143b90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f70e00640 1 --2- 172.21.15.31:0/3373168380 >> v2:172.21.15.59:3300/0 conn(0x7f7f6c0adaa0 0x7f7f6c0b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.853+0000 7f7f70e00640 1 -- 172.21.15.31:0/3373168380 >> 172.21.15.31:0/3373168380 conn(0x7f7f6c0b85b0 msgr2=0x7f7f6c0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.854+0000 7f7f70e00640 1 -- 172.21.15.31:0/3373168380 shutdown_connections 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.854+0000 7f7f70e00640 1 -- 172.21.15.31:0/3373168380 wait complete. 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.855+0000 7f7f70e00640 1 Processor -- start 2024-03-23T23:56:41.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.855+0000 7f7f70e00640 1 -- start start 2024-03-23T23:56:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f70e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c09e0c0 0x7f7f6c1dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f70e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c0b5bb0 0x7f7f6c09ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f70e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09d210 0x7f7f6c09bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f70e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c144250 con 0x7f7f6c09d210 2024-03-23T23:56:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f70e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c1440d0 con 0x7f7f6c0b5bb0 2024-03-23T23:56:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f70e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c1443d0 con 0x7f7f6c09e0c0 2024-03-23T23:56:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09d210 0x7f7f6c09bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09d210 0x7f7f6c09bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33104/0 (socket says 172.21.15.31:33104) 2024-03-23T23:56:41.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.856+0000 7f7f6be00640 1 -- 172.21.15.31:0/689733764 learned_addr learned my addr 172.21.15.31:0/689733764 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f63e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c0b5bb0 0x7f7f6c09ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f6be00640 1 -- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c09e0c0 msgr2=0x7f7f6c1dfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f6be00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c09e0c0 0x7f7f6c1dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f6be00640 1 -- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c0b5bb0 msgr2=0x7f7f6c09ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:41.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f6be00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c0b5bb0 0x7f7f6c09ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f6be00640 1 -- 172.21.15.31:0/689733764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c1cd0e0 con 0x7f7f6c09d210 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f63e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c0b5bb0 0x7f7f6c09ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f6be00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09d210 0x7f7f6c09bf20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400d240 tx=0x7f7f64004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f63400640 1 -- 172.21.15.31:0/689733764 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64046030 con 0x7f7f6c09d210 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f63400640 1 -- 172.21.15.31:0/689733764 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f64008cc0 con 0x7f7f6c09d210 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f63400640 1 -- 172.21.15.31:0/689733764 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64042640 con 0x7f7f6c09d210 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c09ba00 con 0x7f7f6c09d210 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.857+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c09c460 con 0x7f7f6c09d210 2024-03-23T23:56:41.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.858+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c09a110 con 0x7f7f6c09d210 2024-03-23T23:56:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.859+0000 7f7f63400640 1 -- 172.21.15.31:0/689733764 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7f64049070 con 0x7f7f6c09d210 2024-03-23T23:56:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.860+0000 7f7f63400640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7f4806bbd0 0x7f7f4806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:41.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.860+0000 7f7f63400640 1 -- 172.21.15.31:0/689733764 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f640acd50 con 0x7f7f6c09d210 2024-03-23T23:56:41.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.861+0000 7f7f6b400640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7f4806bbd0 0x7f7f4806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:41.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.862+0000 7f7f6b400640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7f4806bbd0 0x7f7f4806e090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c001560 tx=0x7f7f5c007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:41.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:41.865+0000 7f7f63400640 1 -- 172.21.15.31:0/689733764 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f7f6c09a110 con 0x7f7f6c09d210 2024-03-23T23:56:42.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.111+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7f6c0752c0 con 0x7f7f6c09d210 2024-03-23T23:56:42.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.111+0000 7f7f63400640 1 -- 172.21.15.31:0/689733764 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7f64050070 con 0x7f7f6c09d210 2024-03-23T23:56:42.112 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:42.112 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-23T23:56:42.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7f4806bbd0 msgr2=0x7f7f4806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7f4806bbd0 0x7f7f4806e090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c001560 tx=0x7f7f5c007990 comp rx=0 tx=0).stop 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09d210 msgr2=0x7f7f6c09bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09d210 0x7f7f6c09bf20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400d240 tx=0x7f7f64004ab0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 shutdown_connections 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7f4806bbd0 0x7f7f4806e090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6c0b5bb0 0x7f7f6c09ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f6c09d210 0x7f7f6c09bf20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 --2- 172.21.15.31:0/689733764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6c09e0c0 0x7f7f6c1dfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.114+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 >> 172.21.15.31:0/689733764 conn(0x7f7f6c0b85b0 msgr2=0x7f7f6c0b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.115+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 shutdown_connections 2024-03-23T23:56:42.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.115+0000 7f7f70e00640 1 -- 172.21.15.31:0/689733764 wait complete. 2024-03-23T23:56:42.133 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-23T23:56:42.133 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:42.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.356+0000 7f81e7e00640 1 Processor -- start 2024-03-23T23:56:42.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.356+0000 7f81e7e00640 1 -- start start 2024-03-23T23:56:42.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.357+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 0x7f81e80af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.357+0000 7f81e7e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e80b7d10 con 0x7f81e80b7930 2024-03-23T23:56:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.358+0000 7f81e7e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e80b4d50 con 0x7f81e80b32c0 2024-03-23T23:56:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.358+0000 7f81e7e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b3900 con 0x7f81e8147e70 2024-03-23T23:56:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.358+0000 7f81e6a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f81e80b7930 0x7f81e8147760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59574/0 (socket says 172.21.15.31:59574) 2024-03-23T23:56:42.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.358+0000 7f81e6a00640 1 -- 172.21.15.31:0/3084586293 learned_addr learned my addr 172.21.15.31:0/3084586293 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:42.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.358+0000 7f81e7400640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 0x7f81e80af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.358+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487702650 0 0) 0x7f81e80b7d10 con 0x7f81e80b7930 2024-03-23T23:56:42.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.358+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81cc003520 con 0x7f81e80b7930 2024-03-23T23:56:42.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480052480 0 0) 0x7f81cc003520 con 0x7f81e80b7930 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 msgr2=0x7f81e80af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 0x7f81e80af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 >> v1:172.21.15.59:6789/0 conn(0x7f81e80b32c0 legacy=0x7f81e80aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80b3b50 con 0x7f81e80b7930 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f81d8001670 con 0x7f81e80b7930 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 >> v1:172.21.15.31:6789/0 conn(0x7f81e80b7930 legacy=0x7f81e8147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81cc003a50 0x7f81cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 0x7f81cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc004d90 0x7f81cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b3900 con 0x7f81cc003a50 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc00de80 con 0x7f81cc004d90 2024-03-23T23:56:42.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc00e080 con 0x7f81e8147e70 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.359+0000 7f81e6a00640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81cc003a50 0x7f81cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e6000640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 0x7f81cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e7400640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc004d90 0x7f81cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e6a00640 1 -- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 msgr2=0x7f81cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e6a00640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 0x7f81cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e6a00640 1 -- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc004d90 msgr2=0x7f81cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e6a00640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81cc004d90 0x7f81cc005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e6a00640 1 -- 172.21.15.31:0/3084586293 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc003520 con 0x7f81cc003a50 2024-03-23T23:56:42.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.360+0000 7f81e6000640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8147e70 0x7f81cc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:42.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.361+0000 7f81e6a00640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81cc003a50 0x7f81cc003e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c0e0 tx=0x7f81cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6efe89365602219 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:42.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.361+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8007c20 con 0x7f81cc003a50 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.361+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8030070 con 0x7f81cc003a50 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.361+0000 7f81e5600640 1 -- 172.21.15.31:0/3084586293 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8005d10 con 0x7f81cc003a50 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.362+0000 7f81e7e00640 1 -- 172.21.15.31:0/3084586293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81cc003a50 msgr2=0x7f81cc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.362+0000 7f81e7e00640 1 --2- 172.21.15.31:0/3084586293 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81cc003a50 0x7f81cc003e70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c0e0 tx=0x7f81cc005830 comp rx=0 tx=0).stop 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.362+0000 7f81e7400640 1 -- 172.21.15.31:0/3084586293 reap_dead start 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.362+0000 7f81e7e00640 1 -- 172.21.15.31:0/3084586293 shutdown_connections 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.362+0000 7f81e7e00640 1 -- 172.21.15.31:0/3084586293 >> 172.21.15.31:0/3084586293 conn(0x7f81e806cf40 msgr2=0x7f81e806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.362+0000 7f81e7e00640 1 -- 172.21.15.31:0/3084586293 shutdown_connections 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.362+0000 7f81e7e00640 1 -- 172.21.15.31:0/3084586293 wait complete. 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.364+0000 7f81e7e00640 1 Processor -- start 2024-03-23T23:56:42.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.364+0000 7f81e7e00640 1 -- start start 2024-03-23T23:56:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.364+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81cc003a50 0x7f81e81ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.364+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81e81d8430 0x7f81e81dc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e81d8d20 0x7f81e80af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e7e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b51f0 con 0x7f81e81d8430 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b49d0 con 0x7f81e81d8d20 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e7e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b5370 con 0x7f81cc003a50 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81e81d8430 0x7f81e81dc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81e81d8430 0x7f81e81dc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33120/0 (socket says 172.21.15.31:33120) 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 -- 172.21.15.31:0/1489031453 learned_addr learned my addr 172.21.15.31:0/1489031453 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6a00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81cc003a50 0x7f81e81ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e7400640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e81d8d20 0x7f81e80af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 -- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81cc003a50 msgr2=0x7f81e81ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81cc003a50 0x7f81e81ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 -- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e81d8d20 msgr2=0x7f81e80af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e81d8d20 0x7f81e80af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e6000640 1 -- 172.21.15.31:0/1489031453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e81cf990 con 0x7f81e81d8430 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.365+0000 7f81e7400640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e81d8d20 0x7f81e80af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:42.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.366+0000 7f81e6000640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81e81d8430 0x7f81e81dc2d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81d400d540 tx=0x7f81d400da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.366+0000 7f81dea00640 1 -- 172.21.15.31:0/1489031453 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4005480 con 0x7f81e81d8430 2024-03-23T23:56:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.366+0000 7f81dea00640 1 -- 172.21.15.31:0/1489031453 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4017070 con 0x7f81e81d8430 2024-03-23T23:56:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.366+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e81dbad0 con 0x7f81e81d8430 2024-03-23T23:56:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.366+0000 7f81dea00640 1 -- 172.21.15.31:0/1489031453 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4003850 con 0x7f81e81d8430 2024-03-23T23:56:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.366+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e806fe60 con 0x7f81e81d8430 2024-03-23T23:56:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.367+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e80752c0 con 0x7f81e81d8430 2024-03-23T23:56:42.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.369+0000 7f81dea00640 1 -- 172.21.15.31:0/1489031453 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f81d40039f0 con 0x7f81e81d8430 2024-03-23T23:56:42.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.370+0000 7f81dea00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f81c806bc00 0x7f81c806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.370+0000 7f81dea00640 1 -- 172.21.15.31:0/1489031453 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81d408a7f0 con 0x7f81e81d8430 2024-03-23T23:56:42.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.370+0000 7f81e6a00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f81c806bc00 0x7f81c806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.371+0000 7f81e6a00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f81c806bc00 0x7f81c806e0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f81d8034000 tx=0x7f81d8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:42.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.374+0000 7f81dea00640 1 -- 172.21.15.31:0/1489031453 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f81d40592d0 con 0x7f81e81d8430 2024-03-23T23:56:42.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.576+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81e8144e40 con 0x7f81e81d8430 2024-03-23T23:56:42.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.580+0000 7f81dea00640 1 -- 172.21.15.31:0/1489031453 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f81d4058bd0 con 0x7f81e81d8430 2024-03-23T23:56:42.580 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:42.580 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:31.864837+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.582+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f81c806bc00 msgr2=0x7f81c806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.582+0000 7f81e7e00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f81c806bc00 0x7f81c806e0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f81d8034000 tx=0x7f81d8007000 comp rx=0 tx=0).stop 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.582+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81e81d8430 msgr2=0x7f81e81dc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.582+0000 7f81e7e00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81e81d8430 0x7f81e81dc2d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81d400d540 tx=0x7f81d400da00 comp rx=0 tx=0).stop 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.582+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 shutdown_connections 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.582+0000 7f81e7e00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f81c806bc00 0x7f81c806e0c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.583+0000 7f81e7e00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e81d8d20 0x7f81e80af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.583+0000 7f81e7e00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81e81d8430 0x7f81e81dc2d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.583+0000 7f81e7e00640 1 --2- 172.21.15.31:0/1489031453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81cc003a50 0x7f81e81ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.583+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 >> 172.21.15.31:0/1489031453 conn(0x7f81e806cf40 msgr2=0x7f81e80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:42.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.583+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 shutdown_connections 2024-03-23T23:56:42.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.583+0000 7f81e7e00640 1 -- 172.21.15.31:0/1489031453 wait complete. 2024-03-23T23:56:42.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:56:19.394330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T23:56:27.885317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T23:56:29.338633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:56:42.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:56:42.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.828+0000 7f15a0c00640 1 Processor -- start 2024-03-23T23:56:42.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.828+0000 7f15a0c00640 1 -- start start 2024-03-23T23:56:42.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f15a0c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c142080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f15a0c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f159c0b3870 0x7f159c1425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f15a0c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c09c8b0 con 0x7f159c148850 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f15a0c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c149020 con 0x7f159c0b3870 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f15a0c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c149300 con 0x7f159c09b660 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f159be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f159c0b3870 0x7f159c1425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f159be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f159c0b3870 0x7f159c1425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33122/0 (socket says 172.21.15.31:33122) 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f159be00640 1 -- 172.21.15.31:0/2367461784 learned_addr learned my addr 172.21.15.31:0/2367461784 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f1593e00640 1 --2- 172.21.15.31:0/2367461784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f159be00640 1 -- 172.21.15.31:0/2367461784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 msgr2=0x7f159c142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:42.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f159be00640 1 --2- 172.21.15.31:0/2367461784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.830+0000 7f159be00640 1 -- 172.21.15.31:0/2367461784 >> v1:172.21.15.59:6789/0 conn(0x7f159c148850 legacy=0x7f159c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:42.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.831+0000 7f159be00640 1 -- 172.21.15.31:0/2367461784 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c142b00 con 0x7f159c0b3870 2024-03-23T23:56:42.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.832+0000 7f159be00640 1 --2- 172.21.15.31:0/2367461784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c1425c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1594009e50 tx=0x7f159402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc56d0c35e15a8b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:42.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.832+0000 7f159aa00640 1 -- 172.21.15.31:0/2367461784 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159402c950 con 0x7f159c0b3870 2024-03-23T23:56:42.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.832+0000 7f159aa00640 1 -- 172.21.15.31:0/2367461784 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159402caf0 con 0x7f159c0b3870 2024-03-23T23:56:42.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.832+0000 7f159aa00640 1 -- 172.21.15.31:0/2367461784 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940343f0 con 0x7f159c0b3870 2024-03-23T23:56:42.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.832+0000 7f15a0c00640 1 -- 172.21.15.31:0/2367461784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 msgr2=0x7f159c1425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.832+0000 7f15a0c00640 1 --2- 172.21.15.31:0/2367461784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c1425c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1594009e50 tx=0x7f159402bdb0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.833+0000 7f15a0c00640 1 -- 172.21.15.31:0/2367461784 shutdown_connections 2024-03-23T23:56:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.833+0000 7f15a0c00640 1 --2- 172.21.15.31:0/2367461784 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c1425c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.833+0000 7f15a0c00640 1 --2- 172.21.15.31:0/2367461784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.833+0000 7f15a0c00640 1 -- 172.21.15.31:0/2367461784 >> 172.21.15.31:0/2367461784 conn(0x7f159c0b85b0 msgr2=0x7f159c0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.833+0000 7f15a0c00640 1 -- 172.21.15.31:0/2367461784 shutdown_connections 2024-03-23T23:56:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.833+0000 7f15a0c00640 1 -- 172.21.15.31:0/2367461784 wait complete. 2024-03-23T23:56:42.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.834+0000 7f15a0c00640 1 Processor -- start 2024-03-23T23:56:42.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.835+0000 7f15a0c00640 1 -- start start 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.835+0000 7f15a0c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c13af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.835+0000 7f15a0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.835+0000 7f15a0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c148850 0x7f159c13de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.835+0000 7f15a0c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0b94f0 con 0x7f159c0b3870 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.835+0000 7f15a0c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0b9370 con 0x7f159c148850 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.835+0000 7f15a0c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c148c30 con 0x7f159c09b660 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c0aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33130/0 (socket says 172.21.15.31:33130) 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 -- 172.21.15.31:0/1754348540 learned_addr learned my addr 172.21.15.31:0/1754348540 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f159b400640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c13af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f159be00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c148850 0x7f159c13de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 -- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 msgr2=0x7f159c13af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c13af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 -- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c148850 msgr2=0x7f159c13de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c148850 0x7f159c13de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 -- 172.21.15.31:0/1754348540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c13f0a0 con 0x7f159c0b3870 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f159be00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c148850 0x7f159c13de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.836+0000 7f1593e00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c0aeb40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f158400d5f0 tx=0x7f158400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.837+0000 7f1593400640 1 -- 172.21.15.31:0/1754348540 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840125f0 con 0x7f159c0b3870 2024-03-23T23:56:42.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.837+0000 7f1593400640 1 -- 172.21.15.31:0/1754348540 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584019070 con 0x7f159c0b3870 2024-03-23T23:56:42.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.837+0000 7f1593400640 1 -- 172.21.15.31:0/1754348540 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840129d0 con 0x7f159c0b3870 2024-03-23T23:56:42.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.837+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c13d8f0 con 0x7f159c0b3870 2024-03-23T23:56:42.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.837+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c0b3160 con 0x7f159c0b3870 2024-03-23T23:56:42.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.838+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c140280 con 0x7f159c0b3870 2024-03-23T23:56:42.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.839+0000 7f1593400640 1 -- 172.21.15.31:0/1754348540 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1584012b70 con 0x7f159c0b3870 2024-03-23T23:56:42.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.840+0000 7f1593400640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f157806bc20 0x7f157806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:42.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.840+0000 7f1593400640 1 -- 172.21.15.31:0/1754348540 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f158408ae40 con 0x7f159c0b3870 2024-03-23T23:56:42.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.841+0000 7f159b400640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f157806bc20 0x7f157806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:42.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.842+0000 7f159b400640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f157806bc20 0x7f157806e0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f158c006fd0 tx=0x7f158c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:42.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:42.845+0000 7f1593400640 1 -- 172.21.15.31:0/1754348540 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f159c140280 con 0x7f159c0b3870 2024-03-23T23:56:43.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.047+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f159c0752c0 con 0x7f159c0b3870 2024-03-23T23:56:43.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.048+0000 7f1593400640 1 -- 172.21.15.31:0/1754348540 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1584059910 con 0x7f159c0b3870 2024-03-23T23:56:43.048 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-03-23T23:56:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f157806bc20 msgr2=0x7f157806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f157806bc20 0x7f157806e0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f158c006fd0 tx=0x7f158c008040 comp rx=0 tx=0).stop 2024-03-23T23:56:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 msgr2=0x7f159c0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c0aeb40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f158400d5f0 tx=0x7f158400dab0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 shutdown_connections 2024-03-23T23:56:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f157806bc20 0x7f157806e0e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c148850 0x7f159c13de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f159c0b3870 0x7f159c0aeb40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 --2- 172.21.15.31:0/1754348540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c09b660 0x7f159c13af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 >> 172.21.15.31:0/1754348540 conn(0x7f159c0b85b0 msgr2=0x7f159c13c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:43.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 shutdown_connections 2024-03-23T23:56:43.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.051+0000 7f15a0c00640 1 -- 172.21.15.31:0/1754348540 wait complete. 2024-03-23T23:56:43.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T23:56:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.285+0000 7fc789e00640 1 Processor -- start 2024-03-23T23:56:43.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.285+0000 7fc789e00640 1 -- start start 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc789e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7840b50a0 0x7fc784147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc789e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b9810 0x7fc784141340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc789e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840b9330 con 0x7fc7840b6b50 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc789e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc784147660 con 0x7fc7840b50a0 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc789e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc784141880 con 0x7fc7840b9810 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc788a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7840b50a0 0x7fc784147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc783e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc7840b6b50 0x7fc784140c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59590/0 (socket says 172.21.15.31:59590) 2024-03-23T23:56:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc788a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7840b50a0 0x7fc784147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33134/0 (socket says 172.21.15.31:33134) 2024-03-23T23:56:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.287+0000 7fc783e00640 1 -- 172.21.15.31:0/1313805548 learned_addr learned my addr 172.21.15.31:0/1313805548 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.288+0000 7fc789400640 1 --2- 172.21.15.31:0/1313805548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b9810 0x7fc784141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.288+0000 7fc788a00640 1 -- 172.21.15.31:0/1313805548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b9810 msgr2=0x7fc784141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.288+0000 7fc788a00640 1 --2- 172.21.15.31:0/1313805548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b9810 0x7fc784141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.288+0000 7fc788a00640 1 -- 172.21.15.31:0/1313805548 >> v1:172.21.15.31:6789/0 conn(0x7fc7840b6b50 legacy=0x7fc784140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.288+0000 7fc788a00640 1 -- 172.21.15.31:0/1313805548 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840b5480 con 0x7fc7840b50a0 2024-03-23T23:56:43.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.288+0000 7fc783400640 1 -- 172.21.15.31:0/1313805548 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131016776 0 0) 0x7fc7840b9330 con 0x7fc7840b6b50 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.289+0000 7fc788a00640 1 --2- 172.21.15.31:0/1313805548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc784147120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7780097a0 tx=0x7fc77802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c429c9781638b67 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.289+0000 7fc783400640 1 -- 172.21.15.31:0/1313805548 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780315a0 con 0x7fc7840b50a0 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.289+0000 7fc783400640 1 -- 172.21.15.31:0/1313805548 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778037070 con 0x7fc7840b50a0 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.289+0000 7fc783400640 1 -- 172.21.15.31:0/1313805548 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778031960 con 0x7fc7840b50a0 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 -- 172.21.15.31:0/1313805548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 msgr2=0x7fc784147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 --2- 172.21.15.31:0/1313805548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc784147120 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7780097a0 tx=0x7fc77802b840 comp rx=0 tx=0).stop 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 -- 172.21.15.31:0/1313805548 shutdown_connections 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 --2- 172.21.15.31:0/1313805548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b9810 0x7fc784141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 --2- 172.21.15.31:0/1313805548 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc784147120 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 -- 172.21.15.31:0/1313805548 >> 172.21.15.31:0/1313805548 conn(0x7fc784066dd0 msgr2=0x7fc7840671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 -- 172.21.15.31:0/1313805548 shutdown_connections 2024-03-23T23:56:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.290+0000 7fc789e00640 1 -- 172.21.15.31:0/1313805548 wait complete. 2024-03-23T23:56:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 Processor -- start 2024-03-23T23:56:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 -- start start 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc7840bc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b6b50 0x7fc78414af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7840b9810 0x7fc7841df970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840b4000 con 0x7fc7840b50a0 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840b63e0 con 0x7fc7840b9810 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.292+0000 7fc789e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840b42e0 con 0x7fc7840b6b50 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc7840bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc7840bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33142/0 (socket says 172.21.15.31:33142) 2024-03-23T23:56:43.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 -- 172.21.15.31:0/1808415253 learned_addr learned my addr 172.21.15.31:0/1808415253 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 -- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b6b50 msgr2=0x7fc78414af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b6b50 0x7fc78414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 -- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7840b9810 msgr2=0x7fc7841df970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc789400640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7840b9810 0x7fc7841df970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7840b9810 0x7fc7841df970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 -- 172.21.15.31:0/1808415253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc784149700 con 0x7fc7840b50a0 2024-03-23T23:56:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.293+0000 7fc788a00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc7840bc310 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7780098c0 tx=0x7fc7780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.294+0000 7fc780c00640 1 -- 172.21.15.31:0/1808415253 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778032840 con 0x7fc7840b50a0 2024-03-23T23:56:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.294+0000 7fc780c00640 1 -- 172.21.15.31:0/1808415253 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780329e0 con 0x7fc7840b50a0 2024-03-23T23:56:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.294+0000 7fc780c00640 1 -- 172.21.15.31:0/1808415253 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778032dd0 con 0x7fc7840b50a0 2024-03-23T23:56:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.294+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7841499e0 con 0x7fc7840b50a0 2024-03-23T23:56:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.294+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784149fa0 con 0x7fc7840b50a0 2024-03-23T23:56:43.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.295+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7840752c0 con 0x7fc7840b50a0 2024-03-23T23:56:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.296+0000 7fc780c00640 1 -- 172.21.15.31:0/1808415253 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc77804d3f0 con 0x7fc7840b50a0 2024-03-23T23:56:43.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.297+0000 7fc780c00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc76406bbd0 0x7fc76406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.297+0000 7fc780c00640 1 -- 172.21.15.31:0/1808415253 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc77802f030 con 0x7fc7840b50a0 2024-03-23T23:56:43.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.298+0000 7fc783e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc76406bbd0 0x7fc76406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.299+0000 7fc783e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc76406bbd0 0x7fc76406e090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc770007fd0 tx=0x7fc770007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.301+0000 7fc780c00640 1 -- 172.21.15.31:0/1808415253 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fc778040070 con 0x7fc7840b50a0 2024-03-23T23:56:43.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.501+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc784142450 con 0x7fc7840b50a0 2024-03-23T23:56:43.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.502+0000 7fc780c00640 1 -- 172.21.15.31:0/1808415253 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc77807b000 con 0x7fc7840b50a0 2024-03-23T23:56:43.502 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-03-23T23:56:43.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc76406bbd0 msgr2=0x7fc76406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc76406bbd0 0x7fc76406e090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc770007fd0 tx=0x7fc770007920 comp rx=0 tx=0).stop 2024-03-23T23:56:43.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 msgr2=0x7fc7840bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc7840bc310 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc7780098c0 tx=0x7fc7780046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 shutdown_connections 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc76406bbd0 0x7fc76406e090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7840b9810 0x7fc7841df970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7840b6b50 0x7fc78414af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 --2- 172.21.15.31:0/1808415253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7840b50a0 0x7fc7840bc310 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 >> 172.21.15.31:0/1808415253 conn(0x7fc784066dd0 msgr2=0x7fc784140a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 shutdown_connections 2024-03-23T23:56:43.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.505+0000 7fc789e00640 1 -- 172.21.15.31:0/1808415253 wait complete. 2024-03-23T23:56:43.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T23:56:43.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.747+0000 7f810be00640 1 Processor -- start 2024-03-23T23:56:43.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.747+0000 7f810be00640 1 -- start start 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.748+0000 7f810be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f810c0aebf0 0x7f810c148730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.748+0000 7f810be00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0af460 0x7f810c14af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.748+0000 7f810be00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c147610 con 0x7f810c0aefd0 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.748+0000 7f810be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c0ae180 con 0x7f810c0aebf0 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.748+0000 7f810be00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c1478f0 con 0x7f810c0af460 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.749+0000 7f810aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f810c0aebf0 0x7f810c148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.749+0000 7f810b400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0af460 0x7f810c14af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.749+0000 7f810aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f810c0aebf0 0x7f810c148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:45586/0 (socket says 172.21.15.31:45586) 2024-03-23T23:56:43.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.749+0000 7f8103e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f810c0aefd0 0x7f810c14a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.31:48360/0 (socket says 172.21.15.31:48360) 2024-03-23T23:56:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.749+0000 7f810aa00640 1 -- 172.21.15.31:0/1104678224 learned_addr learned my addr 172.21.15.31:0/1104678224 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.749+0000 7f810b400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0af460 0x7f810c14af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:33046/0 (socket says 172.21.15.31:33046) 2024-03-23T23:56:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.750+0000 7f810b400640 1 -- 172.21.15.31:0/1104678224 >> v2:172.21.15.59:3300/0 conn(0x7f810c0aebf0 msgr2=0x7f810c148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.750+0000 7f810b400640 1 --2- 172.21.15.31:0/1104678224 >> v2:172.21.15.59:3300/0 conn(0x7f810c0aebf0 0x7f810c148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.750+0000 7f810b400640 1 -- 172.21.15.31:0/1104678224 >> v1:172.21.15.59:6789/0 conn(0x7f810c0aefd0 legacy=0x7f810c14a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.750+0000 7f810b400640 1 -- 172.21.15.31:0/1104678224 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c147bd0 con 0x7f810c0af460 2024-03-23T23:56:43.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.751+0000 7f810b400640 1 --2- 172.21.15.31:0/1104678224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0af460 0x7f810c14af40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8104009d90 tx=0x7f810402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f974ea636fc07d47 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.752+0000 7f810a000640 1 -- 172.21.15.31:0/1104678224 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104039070 con 0x7f810c0af460 2024-03-23T23:56:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.752+0000 7f810a000640 1 -- 172.21.15.31:0/1104678224 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810402cbc0 con 0x7f810c0af460 2024-03-23T23:56:43.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.752+0000 7f810a000640 1 -- 172.21.15.31:0/1104678224 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104034440 con 0x7f810c0af460 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.752+0000 7f810be00640 1 -- 172.21.15.31:0/1104678224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0af460 msgr2=0x7f810c14af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.752+0000 7f810be00640 1 --2- 172.21.15.31:0/1104678224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0af460 0x7f810c14af40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8104009d90 tx=0x7f810402be10 comp rx=0 tx=0).stop 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.753+0000 7f810be00640 1 -- 172.21.15.31:0/1104678224 shutdown_connections 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.753+0000 7f810be00640 1 --2- 172.21.15.31:0/1104678224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0af460 0x7f810c14af40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.753+0000 7f810be00640 1 --2- 172.21.15.31:0/1104678224 >> v2:172.21.15.59:3300/0 conn(0x7f810c0aebf0 0x7f810c148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.753+0000 7f810be00640 1 -- 172.21.15.31:0/1104678224 >> 172.21.15.31:0/1104678224 conn(0x7f810c0b85b0 msgr2=0x7f810c0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.753+0000 7f810be00640 1 -- 172.21.15.31:0/1104678224 shutdown_connections 2024-03-23T23:56:43.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.753+0000 7f810be00640 1 -- 172.21.15.31:0/1104678224 wait complete. 2024-03-23T23:56:43.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.754+0000 7f810be00640 1 Processor -- start 2024-03-23T23:56:43.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.755+0000 7f810be00640 1 -- start start 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.755+0000 7f810be00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0aebf0 0x7f810c1d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.755+0000 7f810be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f810c0aefd0 0x7f810c1dca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f810be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c0af460 0x7f810c13de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f810be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c148270 con 0x7f810c0aefd0 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f810be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c1480f0 con 0x7f810c0af460 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f810be00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c148c70 con 0x7f810c0aebf0 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f810c0aefd0 0x7f810c1dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f810c0aefd0 0x7f810c1dca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33150/0 (socket says 172.21.15.31:33150) 2024-03-23T23:56:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 -- 172.21.15.31:0/3413061211 learned_addr learned my addr 172.21.15.31:0/3413061211 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f810aa00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0aebf0 0x7f810c1d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f810b400640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c0af460 0x7f810c13de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 -- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0aebf0 msgr2=0x7f810c1d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0aebf0 0x7f810c1d3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 -- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c0af460 msgr2=0x7f810c13de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c0af460 0x7f810c13de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f8103e00640 1 -- 172.21.15.31:0/3413061211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c13ea80 con 0x7f810c0aefd0 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.756+0000 7f810b400640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c0af460 0x7f810c13de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.757+0000 7f8103e00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f810c0aefd0 0x7f810c1dca50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c430 tx=0x7f80f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.757+0000 7f8102a00640 1 -- 172.21.15.31:0/3413061211 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f40074e0 con 0x7f810c0aefd0 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.757+0000 7f8102a00640 1 -- 172.21.15.31:0/3413061211 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f4007680 con 0x7f810c0aefd0 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.757+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c13cef0 con 0x7f810c0aefd0 2024-03-23T23:56:43.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.757+0000 7f8102a00640 1 -- 172.21.15.31:0/3413061211 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4004a00 con 0x7f810c0aefd0 2024-03-23T23:56:43.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.757+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c1dcf90 con 0x7f810c0aefd0 2024-03-23T23:56:43.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.758+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c0752c0 con 0x7f810c0aefd0 2024-03-23T23:56:43.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.759+0000 7f8102a00640 1 -- 172.21.15.31:0/3413061211 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f80f401a020 con 0x7f810c0aefd0 2024-03-23T23:56:43.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.760+0000 7f8102a00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f80e806bc00 0x7f80e806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:43.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.760+0000 7f8102a00640 1 -- 172.21.15.31:0/3413061211 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80f408a260 con 0x7f810c0aefd0 2024-03-23T23:56:43.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.761+0000 7f810aa00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f80e806bc00 0x7f80e806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:43.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.762+0000 7f810aa00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f80e806bc00 0x7f80e806e0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f810c1451e0 tx=0x7f80fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:43.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.765+0000 7f8102a00640 1 -- 172.21.15.31:0/3413061211 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f80f4058d40 con 0x7f810c0aefd0 2024-03-23T23:56:43.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.967+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f810c09d640 con 0x7f810c0aefd0 2024-03-23T23:56:43.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.968+0000 7f8102a00640 1 -- 172.21.15.31:0/3413061211 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80f4058640 con 0x7f810c0aefd0 2024-03-23T23:56:43.968 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.970+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f80e806bc00 msgr2=0x7f80e806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.970+0000 7f810be00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f80e806bc00 0x7f80e806e0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f810c1451e0 tx=0x7f80fc008040 comp rx=0 tx=0).stop 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.970+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f810c0aefd0 msgr2=0x7f810c1dca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.970+0000 7f810be00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f810c0aefd0 0x7f810c1dca50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c430 tx=0x7f80f400c8f0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 shutdown_connections 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f80e806bc00 0x7f80e806e0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f810c0af460 0x7f810c13de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f810c0aefd0 0x7f810c1dca50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 --2- 172.21.15.31:0/3413061211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f810c0aebf0 0x7f810c1d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 >> 172.21.15.31:0/3413061211 conn(0x7f810c0b85b0 msgr2=0x7f810c145230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 shutdown_connections 2024-03-23T23:56:43.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:43.971+0000 7f810be00640 1 -- 172.21.15.31:0/3413061211 wait complete. 2024-03-23T23:56:43.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:56:44.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.209+0000 7ff557200640 1 Processor -- start 2024-03-23T23:56:44.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.209+0000 7ff557200640 1 -- start start 2024-03-23T23:56:44.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.210+0000 7ff557200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff558142380 0x7ff5581427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff557200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580b8c90 con 0x7ff558148950 2024-03-23T23:56:44.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff557200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580b49a0 con 0x7ff5580b88b0 2024-03-23T23:56:44.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff557200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580b4f60 con 0x7ff558142380 2024-03-23T23:56:44.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff556800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff558148950 0x7ff558148dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59602/0 (socket says 172.21.15.31:59602) 2024-03-23T23:56:44.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff556800640 1 -- 172.21.15.31:0/705767645 learned_addr learned my addr 172.21.15.31:0/705767645 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:44.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff555400640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff558142380 0x7ff5581427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879402236 0 0) 0x7ff5580b8c90 con 0x7ff558148950 2024-03-23T23:56:44.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.211+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff53c003520 con 0x7ff558148950 2024-03-23T23:56:44.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946016464 0 0) 0x7ff53c003520 con 0x7ff558148950 2024-03-23T23:56:44.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff558142380 msgr2=0x7ff5581427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:44.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff558142380 0x7ff5581427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 >> v1:172.21.15.59:6789/0 conn(0x7ff5580b88b0 legacy=0x7ff5580b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580b4c80 con 0x7ff558148950 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7ff5500019f0 con 0x7ff558148950 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 >> v1:172.21.15.31:6789/0 conn(0x7ff558148950 legacy=0x7ff558148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53c003a50 0x7ff53c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c004800 0x7ff53c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff558142380 0x7ff53c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580b4f60 con 0x7ff53c003a50 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c005580 con 0x7ff53c004800 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c00bf00 con 0x7ff558142380 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.212+0000 7ff555e00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53c003a50 0x7ff53c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.213+0000 7ff555e00640 1 -- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff558142380 msgr2=0x7ff53c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.213+0000 7ff555e00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff558142380 0x7ff53c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.213+0000 7ff555400640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c004800 0x7ff53c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.213+0000 7ff555e00640 1 -- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c004800 msgr2=0x7ff53c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:44.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.213+0000 7ff555e00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c004800 0x7ff53c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.213+0000 7ff555e00640 1 -- 172.21.15.31:0/705767645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c003520 con 0x7ff53c003a50 2024-03-23T23:56:44.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.214+0000 7ff555e00640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53c003a50 0x7ff53c003e70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff548001780 tx=0x7ff53c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad466a069e9eb84e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:44.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.214+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548001370 con 0x7ff53c003a50 2024-03-23T23:56:44.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.214+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5480052d0 con 0x7ff53c003a50 2024-03-23T23:56:44.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.214+0000 7ff554a00640 1 -- 172.21.15.31:0/705767645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548003830 con 0x7ff53c003a50 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.215+0000 7ff557200640 1 -- 172.21.15.31:0/705767645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53c003a50 msgr2=0x7ff53c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.215+0000 7ff557200640 1 --2- 172.21.15.31:0/705767645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff53c003a50 0x7ff53c003e70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff548001780 tx=0x7ff53c005830 comp rx=0 tx=0).stop 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.215+0000 7ff556800640 1 -- 172.21.15.31:0/705767645 reap_dead start 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.215+0000 7ff557200640 1 -- 172.21.15.31:0/705767645 shutdown_connections 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.215+0000 7ff557200640 1 -- 172.21.15.31:0/705767645 >> 172.21.15.31:0/705767645 conn(0x7ff55806cf40 msgr2=0x7ff55806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.215+0000 7ff557200640 1 -- 172.21.15.31:0/705767645 shutdown_connections 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.215+0000 7ff557200640 1 -- 172.21.15.31:0/705767645 wait complete. 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.216+0000 7ff557200640 1 Processor -- start 2024-03-23T23:56:44.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.217+0000 7ff557200640 1 -- start start 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.217+0000 7ff557200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c003a50 0x7ff55809c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.217+0000 7ff557200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5580afd20 0x7ff5581dfe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.217+0000 7ff557200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581e03d0 0x7ff5580976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.217+0000 7ff557200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580b9490 con 0x7ff5581e03d0 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.217+0000 7ff557200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5581427f0 con 0x7ff5580afd20 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.217+0000 7ff557200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580b2a10 con 0x7ff53c003a50 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581e03d0 0x7ff5580976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581e03d0 0x7ff5580976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33164/0 (socket says 172.21.15.31:33164) 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 -- 172.21.15.31:0/2087752780 learned_addr learned my addr 172.21.15.31:0/2087752780 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff555e00640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c003a50 0x7ff55809c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff555400640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5580afd20 0x7ff5581dfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 -- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c003a50 msgr2=0x7ff55809c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c003a50 0x7ff55809c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 -- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5580afd20 msgr2=0x7ff5581dfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5580afd20 0x7ff5581dfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 -- 172.21.15.31:0/2087752780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580ae270 con 0x7ff5581e03d0 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff555e00640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c003a50 0x7ff55809c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.218+0000 7ff556800640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581e03d0 0x7ff5580976b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff5580b6210 tx=0x7ff55000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.219+0000 7ff54e000640 1 -- 172.21.15.31:0/2087752780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550004d60 con 0x7ff5581e03d0 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.219+0000 7ff54e000640 1 -- 172.21.15.31:0/2087752780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55000a5e0 con 0x7ff5581e03d0 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.219+0000 7ff54e000640 1 -- 172.21.15.31:0/2087752780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55000aa10 con 0x7ff5581e03d0 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.219+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5580aeec0 con 0x7ff5581e03d0 2024-03-23T23:56:44.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.219+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5580b06b0 con 0x7ff5581e03d0 2024-03-23T23:56:44.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.220+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5580752c0 con 0x7ff5581e03d0 2024-03-23T23:56:44.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.221+0000 7ff54e000640 1 -- 172.21.15.31:0/2087752780 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff55000abb0 con 0x7ff5581e03d0 2024-03-23T23:56:44.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.222+0000 7ff54e000640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff53806bbd0 0x7ff53806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.222+0000 7ff54e000640 1 -- 172.21.15.31:0/2087752780 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff55008a310 con 0x7ff5581e03d0 2024-03-23T23:56:44.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.223+0000 7ff555e00640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff53806bbd0 0x7ff53806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.224+0000 7ff555e00640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff53806bbd0 0x7ff53806e090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff548033000 tx=0x7ff548009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:44.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.227+0000 7ff54e000640 1 -- 172.21.15.31:0/2087752780 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff55001b020 con 0x7ff5581e03d0 2024-03-23T23:56:44.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.470+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5580b39f0 con 0x7ff5581e03d0 2024-03-23T23:56:44.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.472+0000 7ff54e000640 1 -- 172.21.15.31:0/2087752780 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3388 (secure 0 0 0) 0x7ff55000f260 con 0x7ff5581e03d0 2024-03-23T23:56:44.472 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:44.472 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/481677666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":481677666},{"type":"v1","addr":"172.21.15.31:6833","nonce":481677666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:56:30.337777+0000","modified":"2024-03-23T23:56:33.383201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3774186650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3774186650},{"type":"v1","addr":"172.21.15.59:6835","nonce":3774186650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-03-23T23:56:44.472 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-03-23T23:56:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff53806bbd0 msgr2=0x7ff53806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff53806bbd0 0x7ff53806e090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff548033000 tx=0x7ff548009030 comp rx=0 tx=0).stop 2024-03-23T23:56:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581e03d0 msgr2=0x7ff5580976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581e03d0 0x7ff5580976b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff5580b6210 tx=0x7ff55000cb90 comp rx=0 tx=0).stop 2024-03-23T23:56:44.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 shutdown_connections 2024-03-23T23:56:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff53806bbd0 0x7ff53806e090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5580afd20 0x7ff5581dfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff5581e03d0 0x7ff5580976b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 --2- 172.21.15.31:0/2087752780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c003a50 0x7ff55809c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 >> 172.21.15.31:0/2087752780 conn(0x7ff55806cf40 msgr2=0x7ff5580b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 shutdown_connections 2024-03-23T23:56:44.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.474+0000 7ff557200640 1 -- 172.21.15.31:0/2087752780 wait complete. 2024-03-23T23:56:44.495 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:44.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.717+0000 7ff641600640 1 Processor -- start 2024-03-23T23:56:44.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.717+0000 7ff641600640 1 -- start start 2024-03-23T23:56:44.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff641600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff63c0b5a70 0x7ff63c145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff641600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b27e0 0x7ff63c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff641600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff63c0708f0 0x7ff63c13f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff641600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c145890 con 0x7ff63c0b5a70 2024-03-23T23:56:44.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff641600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c070da0 con 0x7ff63c0708f0 2024-03-23T23:56:44.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff641600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c0b5e50 con 0x7ff63c0b27e0 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff63aa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff63c0b5a70 0x7ff63c145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff63aa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff63c0b5a70 0x7ff63c145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40868/0 (socket says 172.21.15.31:40868) 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff63aa00640 1 -- 172.21.15.31:0/3873857353 learned_addr learned my addr 172.21.15.31:0/3873857353 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.718+0000 7ff63a000640 1 --2- 172.21.15.31:0/3873857353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b27e0 0x7ff63c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.719+0000 7ff63b400640 1 --2- 172.21.15.31:0/3873857353 >> v2:172.21.15.59:3300/0 conn(0x7ff63c0708f0 0x7ff63c13f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.719+0000 7ff63aa00640 1 -- 172.21.15.31:0/3873857353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b27e0 msgr2=0x7ff63c06eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.719+0000 7ff63aa00640 1 --2- 172.21.15.31:0/3873857353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b27e0 0x7ff63c06eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.719+0000 7ff63aa00640 1 -- 172.21.15.31:0/3873857353 >> v2:172.21.15.59:3300/0 conn(0x7ff63c0708f0 msgr2=0x7ff63c13f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.719+0000 7ff63aa00640 1 --2- 172.21.15.31:0/3873857353 >> v2:172.21.15.59:3300/0 conn(0x7ff63c0708f0 0x7ff63c13f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.719+0000 7ff63aa00640 1 -- 172.21.15.31:0/3873857353 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c145240 con 0x7ff63c0b5a70 2024-03-23T23:56:44.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.719+0000 7ff63b400640 1 --2- 172.21.15.31:0/3873857353 >> v2:172.21.15.59:3300/0 conn(0x7ff63c0708f0 0x7ff63c13f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:56:44.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.721+0000 7ff63aa00640 1 --2- 172.21.15.31:0/3873857353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0b5a70 0x7ff63c145d20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff63c06b560 tx=0x7ff62c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e603d64873c6c888 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:44.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.721+0000 7ff639600640 1 -- 172.21.15.31:0/3873857353 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c035020 con 0x7ff63c0b5a70 2024-03-23T23:56:44.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.721+0000 7ff639600640 1 -- 172.21.15.31:0/3873857353 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c031870 con 0x7ff63c0b5a70 2024-03-23T23:56:44.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.721+0000 7ff639600640 1 -- 172.21.15.31:0/3873857353 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c031c40 con 0x7ff63c0b5a70 2024-03-23T23:56:44.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 -- 172.21.15.31:0/3873857353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0b5a70 msgr2=0x7ff63c145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 --2- 172.21.15.31:0/3873857353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0b5a70 0x7ff63c145d20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff63c06b560 tx=0x7ff62c02b910 comp rx=0 tx=0).stop 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 -- 172.21.15.31:0/3873857353 shutdown_connections 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 --2- 172.21.15.31:0/3873857353 >> v2:172.21.15.59:3300/0 conn(0x7ff63c0708f0 0x7ff63c13f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 --2- 172.21.15.31:0/3873857353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b27e0 0x7ff63c06eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 --2- 172.21.15.31:0/3873857353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0b5a70 0x7ff63c145d20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 -- 172.21.15.31:0/3873857353 >> 172.21.15.31:0/3873857353 conn(0x7ff63c066fb0 msgr2=0x7ff63c0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 -- 172.21.15.31:0/3873857353 shutdown_connections 2024-03-23T23:56:44.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.722+0000 7ff641600640 1 -- 172.21.15.31:0/3873857353 wait complete. 2024-03-23T23:56:44.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.723+0000 7ff641600640 1 Processor -- start 2024-03-23T23:56:44.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.724+0000 7ff641600640 1 -- start start 2024-03-23T23:56:44.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.724+0000 7ff641600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0708f0 0x7ff63c0b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff641600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63c0b27e0 0x7ff63c13a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff641600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b5a70 0x7ff63c1357f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff641600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c13f6c0 con 0x7ff63c0708f0 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff641600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c13f540 con 0x7ff63c0b27e0 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff641600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c13f840 con 0x7ff63c0b5a70 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0708f0 0x7ff63c0b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0708f0 0x7ff63c0b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40870/0 (socket says 172.21.15.31:40870) 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 -- 172.21.15.31:0/2757153615 learned_addr learned my addr 172.21.15.31:0/2757153615 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63a000640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63c0b27e0 0x7ff63c13a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63b400640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b5a70 0x7ff63c1357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 -- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b5a70 msgr2=0x7ff63c1357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b5a70 0x7ff63c1357f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 -- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63c0b27e0 msgr2=0x7ff63c13a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63c0b27e0 0x7ff63c13a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.725+0000 7ff63aa00640 1 -- 172.21.15.31:0/2757153615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0b17d0 con 0x7ff63c0708f0 2024-03-23T23:56:44.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.726+0000 7ff63aa00640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0708f0 0x7ff63c0b01d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff62c02b950 tx=0x7ff62c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:44.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.726+0000 7ff632a00640 1 -- 172.21.15.31:0/2757153615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c040070 con 0x7ff63c0708f0 2024-03-23T23:56:44.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.726+0000 7ff632a00640 1 -- 172.21.15.31:0/2757153615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c030d00 con 0x7ff63c0708f0 2024-03-23T23:56:44.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.726+0000 7ff632a00640 1 -- 172.21.15.31:0/2757153615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c035040 con 0x7ff63c0708f0 2024-03-23T23:56:44.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.726+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c1dd4b0 con 0x7ff63c0708f0 2024-03-23T23:56:44.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.726+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c0b1a40 con 0x7ff63c0708f0 2024-03-23T23:56:44.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.728+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c1ddff0 con 0x7ff63c0708f0 2024-03-23T23:56:44.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.728+0000 7ff632a00640 1 -- 172.21.15.31:0/2757153615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff62c04b060 con 0x7ff63c0708f0 2024-03-23T23:56:44.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.730+0000 7ff632a00640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff61c06bbd0 0x7ff61c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:44.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.730+0000 7ff632a00640 1 -- 172.21.15.31:0/2757153615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff62c0ac710 con 0x7ff63c0708f0 2024-03-23T23:56:44.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.731+0000 7ff63a000640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff61c06bbd0 0x7ff61c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:44.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.732+0000 7ff63a000640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff61c06bbd0 0x7ff61c06e090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0b40b0 tx=0x7ff628008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:44.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.734+0000 7ff632a00640 1 -- 172.21.15.31:0/2757153615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff62c07b1f0 con 0x7ff63c0708f0 2024-03-23T23:56:44.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.937+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff63c142d80 con 0x7ff63c0708f0 2024-03-23T23:56:44.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.940+0000 7ff632a00640 1 -- 172.21.15.31:0/2757153615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16533 (secure 0 0 0) 0x7ff62c07aaf0 con 0x7ff63c0708f0 2024-03-23T23:56:44.940 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:44.941 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:31.864837+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff61c06bbd0 msgr2=0x7ff61c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff61c06bbd0 0x7ff61c06e090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0b40b0 tx=0x7ff628008040 comp rx=0 tx=0).stop 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0708f0 msgr2=0x7ff63c0b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0708f0 0x7ff63c0b01d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff62c02b950 tx=0x7ff62c0046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 shutdown_connections 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff61c06bbd0 0x7ff61c06e090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63c0b27e0 0x7ff63c13a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff63c0b5a70 0x7ff63c1357f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 --2- 172.21.15.31:0/2757153615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff63c0708f0 0x7ff63c0b01d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 >> 172.21.15.31:0/2757153615 conn(0x7ff63c066fb0 msgr2=0x7ff63c0b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 shutdown_connections 2024-03-23T23:56:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:44.943+0000 7ff641600640 1 -- 172.21.15.31:0/2757153615 wait complete. 2024-03-23T23:56:44.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:56:44.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:56:44.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T23:56:19.394330+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T23:56:27.885317+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T23:56:29.338633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T23:56:44.965 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T23:56:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.226+0000 7f454be00640 1 Processor -- start 2024-03-23T23:56:45.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.227+0000 7f454be00640 1 -- start start 2024-03-23T23:56:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.228+0000 7f454be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f454c0b51b0 0x7f454c14a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.228+0000 7f454be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f454c14ad80 0x7f454c140e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.228+0000 7f454be00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c0b6b30 0x7f454c141390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.228+0000 7f454be00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c0b8fe0 con 0x7f454c0b51b0 2024-03-23T23:56:45.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.228+0000 7f454be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c0b8d70 con 0x7f454c14ad80 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.228+0000 7f454be00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b9b00 con 0x7f454c0b6b30 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.228+0000 7f454aa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f454c0b51b0 0x7f454c14a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454aa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f454c0b51b0 0x7f454c14a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40882/0 (socket says 172.21.15.31:40882) 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454aa00640 1 -- 172.21.15.31:0/876250457 learned_addr learned my addr 172.21.15.31:0/876250457 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454a000640 1 --2- 172.21.15.31:0/876250457 >> v2:172.21.15.59:3300/0 conn(0x7f454c14ad80 0x7f454c140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454b400640 1 --2- 172.21.15.31:0/876250457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c0b6b30 0x7f454c141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454aa00640 1 -- 172.21.15.31:0/876250457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c0b6b30 msgr2=0x7f454c141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:45.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454aa00640 1 --2- 172.21.15.31:0/876250457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c0b6b30 0x7f454c141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454aa00640 1 -- 172.21.15.31:0/876250457 >> v2:172.21.15.59:3300/0 conn(0x7f454c14ad80 msgr2=0x7f454c140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454aa00640 1 --2- 172.21.15.31:0/876250457 >> v2:172.21.15.59:3300/0 conn(0x7f454c14ad80 0x7f454c140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.229+0000 7f454aa00640 1 -- 172.21.15.31:0/876250457 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0b9fe0 con 0x7f454c0b51b0 2024-03-23T23:56:45.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.230+0000 7f454aa00640 1 --2- 172.21.15.31:0/876250457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c14a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f454c147250 tx=0x7f453c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c269e502e2cfd221 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:45.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f4549600640 1 -- 172.21.15.31:0/876250457 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c02e070 con 0x7f454c0b51b0 2024-03-23T23:56:45.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f4549600640 1 -- 172.21.15.31:0/876250457 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c037070 con 0x7f454c0b51b0 2024-03-23T23:56:45.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f4549600640 1 -- 172.21.15.31:0/876250457 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c031a00 con 0x7f454c0b51b0 2024-03-23T23:56:45.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 -- 172.21.15.31:0/876250457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 msgr2=0x7f454c14a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 --2- 172.21.15.31:0/876250457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c14a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f454c147250 tx=0x7f453c02b880 comp rx=0 tx=0).stop 2024-03-23T23:56:45.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 -- 172.21.15.31:0/876250457 shutdown_connections 2024-03-23T23:56:45.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 --2- 172.21.15.31:0/876250457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c0b6b30 0x7f454c141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 --2- 172.21.15.31:0/876250457 >> v2:172.21.15.59:3300/0 conn(0x7f454c14ad80 0x7f454c140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 --2- 172.21.15.31:0/876250457 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c14a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 -- 172.21.15.31:0/876250457 >> 172.21.15.31:0/876250457 conn(0x7f454c0671f0 msgr2=0x7f454c067600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 -- 172.21.15.31:0/876250457 shutdown_connections 2024-03-23T23:56:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.231+0000 7f454be00640 1 -- 172.21.15.31:0/876250457 wait complete. 2024-03-23T23:56:45.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.233+0000 7f454be00640 1 Processor -- start 2024-03-23T23:56:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.233+0000 7f454be00640 1 -- start start 2024-03-23T23:56:45.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c0bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f454c0b6b30 0x7f454c1e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454be00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c14ad80 0x7f454c137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b5590 con 0x7f454c0b51b0 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c1418d0 con 0x7f454c0b6b30 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454be00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b3dd0 con 0x7f454c14ad80 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c0bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c0bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40884/0 (socket says 172.21.15.31:40884) 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454aa00640 1 -- 172.21.15.31:0/658323142 learned_addr learned my addr 172.21.15.31:0/658323142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.234+0000 7f454a000640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f454c0b6b30 0x7f454c1e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454b400640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c14ad80 0x7f454c137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454aa00640 1 -- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c14ad80 msgr2=0x7f454c137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454aa00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c14ad80 0x7f454c137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454aa00640 1 -- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f454c0b6b30 msgr2=0x7f454c1e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454aa00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f454c0b6b30 0x7f454c1e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454aa00640 1 -- 172.21.15.31:0/658323142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c13a3e0 con 0x7f454c0b51b0 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454a000640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f454c0b6b30 0x7f454c1e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454aa00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c0bcbc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f453c000c00 tx=0x7f453c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f4542a00640 1 -- 172.21.15.31:0/658323142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c032670 con 0x7f454c0b51b0 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f4542a00640 1 -- 172.21.15.31:0/658323142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c032810 con 0x7f454c0b51b0 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f4542a00640 1 -- 172.21.15.31:0/658323142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c032c00 con 0x7f454c0b51b0 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c0bab00 con 0x7f454c0b51b0 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.235+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c1dffa0 con 0x7f454c0b51b0 2024-03-23T23:56:45.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.237+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c0752c0 con 0x7f454c0b51b0 2024-03-23T23:56:45.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.237+0000 7f4542a00640 1 -- 172.21.15.31:0/658323142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f453c0453f0 con 0x7f454c0b51b0 2024-03-23T23:56:45.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.238+0000 7f4542a00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f452806bbd0 0x7f452806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.238+0000 7f4542a00640 1 -- 172.21.15.31:0/658323142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f453c0ac7e0 con 0x7f454c0b51b0 2024-03-23T23:56:45.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.239+0000 7f454a000640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f452806bbd0 0x7f452806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.240+0000 7f454a000640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f452806bbd0 0x7f452806e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f454c144b90 tx=0x7f4534008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:45.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.243+0000 7f4542a00640 1 -- 172.21.15.31:0/658323142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f453c040070 con 0x7f454c0b51b0 2024-03-23T23:56:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.444+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f454c13a100 con 0x7f454c0b51b0 2024-03-23T23:56:45.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.446+0000 7f4542a00640 1 -- 172.21.15.31:0/658323142 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f453c07b2c0 con 0x7f454c0b51b0 2024-03-23T23:56:45.446 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-03-23T23:56:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f452806bbd0 msgr2=0x7f452806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f452806bbd0 0x7f452806e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f454c144b90 tx=0x7f4534008040 comp rx=0 tx=0).stop 2024-03-23T23:56:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 msgr2=0x7f454c0bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c0bcbc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f453c000c00 tx=0x7f453c0046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 shutdown_connections 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f452806bbd0 0x7f452806e090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f454c0b6b30 0x7f454c1e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f454c14ad80 0x7f454c137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 --2- 172.21.15.31:0/658323142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f454c0b51b0 0x7f454c0bcbc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.448+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 >> 172.21.15.31:0/658323142 conn(0x7f454c0671f0 msgr2=0x7f454c0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.449+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 shutdown_connections 2024-03-23T23:56:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.449+0000 7f454be00640 1 -- 172.21.15.31:0/658323142 wait complete. 2024-03-23T23:56:45.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T23:56:45.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.678+0000 7fb919400640 1 Processor -- start 2024-03-23T23:56:45.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.678+0000 7fb919400640 1 -- start start 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.679+0000 7fb919400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9140721a0 0x7fb914148530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.679+0000 7fb919400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb9140b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb919400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9140b8050 0x7fb9140b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb919400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb914072580 con 0x7fb9140721a0 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb919400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140b8630 con 0x7fb9140b8050 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb919400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b8910 con 0x7fb9140b74a0 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9140721a0 0x7fb914148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9140721a0 0x7fb914148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40894/0 (socket says 172.21.15.31:40894) 2024-03-23T23:56:45.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 -- 172.21.15.31:0/3727099554 learned_addr learned my addr 172.21.15.31:0/3727099554 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 -- 172.21.15.31:0/3727099554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 msgr2=0x7fb9140b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913400640 1 --2- 172.21.15.31:0/3727099554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb9140b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb918a00640 1 --2- 172.21.15.31:0/3727099554 >> v2:172.21.15.59:3300/0 conn(0x7fb9140b8050 0x7fb9140b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 --2- 172.21.15.31:0/3727099554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb9140b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 -- 172.21.15.31:0/3727099554 >> v2:172.21.15.59:3300/0 conn(0x7fb9140b8050 msgr2=0x7fb9140b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 --2- 172.21.15.31:0/3727099554 >> v2:172.21.15.59:3300/0 conn(0x7fb9140b8050 0x7fb9140b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.680+0000 7fb913e00640 1 -- 172.21.15.31:0/3727099554 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140b8bf0 con 0x7fb9140721a0 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.681+0000 7fb913e00640 1 --2- 172.21.15.31:0/3727099554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140721a0 0x7fb914148530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb9140729d0 tx=0x7fb8fc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca0982d944e03ea server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.682+0000 7fb912a00640 1 -- 172.21.15.31:0/3727099554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc02e070 con 0x7fb9140721a0 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.682+0000 7fb912a00640 1 -- 172.21.15.31:0/3727099554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc037070 con 0x7fb9140721a0 2024-03-23T23:56:45.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.682+0000 7fb912a00640 1 -- 172.21.15.31:0/3727099554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc031a00 con 0x7fb9140721a0 2024-03-23T23:56:45.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 -- 172.21.15.31:0/3727099554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140721a0 msgr2=0x7fb914148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 --2- 172.21.15.31:0/3727099554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140721a0 0x7fb914148530 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb9140729d0 tx=0x7fb8fc02b880 comp rx=0 tx=0).stop 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 -- 172.21.15.31:0/3727099554 shutdown_connections 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 --2- 172.21.15.31:0/3727099554 >> v2:172.21.15.59:3300/0 conn(0x7fb9140b8050 0x7fb9140b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 --2- 172.21.15.31:0/3727099554 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb9140b6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 --2- 172.21.15.31:0/3727099554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140721a0 0x7fb914148530 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 -- 172.21.15.31:0/3727099554 >> 172.21.15.31:0/3727099554 conn(0x7fb91406db30 msgr2=0x7fb91406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 -- 172.21.15.31:0/3727099554 shutdown_connections 2024-03-23T23:56:45.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.683+0000 7fb919400640 1 -- 172.21.15.31:0/3727099554 wait complete. 2024-03-23T23:56:45.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.684+0000 7fb919400640 1 Processor -- start 2024-03-23T23:56:45.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.684+0000 7fb919400640 1 -- start start 2024-03-23T23:56:45.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.685+0000 7fb919400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9140721a0 0x7fb914149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.685+0000 7fb919400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb91414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.685+0000 7fb919400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b8050 0x7fb91413d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.685+0000 7fb919400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b2fc0 con 0x7fb9140b8050 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.685+0000 7fb919400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b2e40 con 0x7fb9140721a0 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.685+0000 7fb919400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b3140 con 0x7fb9140b74a0 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b8050 0x7fb91413d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b8050 0x7fb91413d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40902/0 (socket says 172.21.15.31:40902) 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 -- 172.21.15.31:0/2236552899 learned_addr learned my addr 172.21.15.31:0/2236552899 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb913e00640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9140721a0 0x7fb914149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb913400640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb91414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 -- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 msgr2=0x7fb91414b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb91414b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 -- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9140721a0 msgr2=0x7fb914149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9140721a0 0x7fb914149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 -- 172.21.15.31:0/2236552899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91414afd0 con 0x7fb9140b8050 2024-03-23T23:56:45.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.686+0000 7fb918a00640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b8050 0x7fb91413d5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c7c0 tx=0x7fb90c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.687+0000 7fb90be00640 1 -- 172.21.15.31:0/2236552899 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c015070 con 0x7fb9140b8050 2024-03-23T23:56:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.687+0000 7fb90be00640 1 -- 172.21.15.31:0/2236552899 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c004220 con 0x7fb9140b8050 2024-03-23T23:56:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.687+0000 7fb90be00640 1 -- 172.21.15.31:0/2236552899 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c007620 con 0x7fb9140b8050 2024-03-23T23:56:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.687+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9141484f0 con 0x7fb9140b8050 2024-03-23T23:56:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.687+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91414bd40 con 0x7fb9140b8050 2024-03-23T23:56:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.688+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9140b6fe0 con 0x7fb9140b8050 2024-03-23T23:56:45.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.689+0000 7fb90be00640 1 -- 172.21.15.31:0/2236552899 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb90c0077c0 con 0x7fb9140b8050 2024-03-23T23:56:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.690+0000 7fb90be00640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb8f006bbd0 0x7fb8f006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.690+0000 7fb90be00640 1 -- 172.21.15.31:0/2236552899 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb90c08a8b0 con 0x7fb9140b8050 2024-03-23T23:56:45.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.690+0000 7fb913e00640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb8f006bbd0 0x7fb8f006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:45.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.692+0000 7fb913e00640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb8f006bbd0 0x7fb8f006e090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc036000 tx=0x7fb8fc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:45.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.694+0000 7fb90be00640 1 -- 172.21.15.31:0/2236552899 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fb9140b6fe0 con 0x7fb9140b8050 2024-03-23T23:56:45.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.898+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9140752c0 con 0x7fb9140b8050 2024-03-23T23:56:45.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.898+0000 7fb90be00640 1 -- 172.21.15.31:0/2236552899 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb90c059450 con 0x7fb9140b8050 2024-03-23T23:56:45.898 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb8f006bbd0 msgr2=0x7fb8f006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb8f006bbd0 0x7fb8f006e090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc036000 tx=0x7fb8fc03d040 comp rx=0 tx=0).stop 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b8050 msgr2=0x7fb91413d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b8050 0x7fb91413d5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c7c0 tx=0x7fb90c00cc80 comp rx=0 tx=0).stop 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 shutdown_connections 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb8f006bbd0 0x7fb8f006e090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9140b8050 0x7fb91413d5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9140b74a0 0x7fb91414b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 --2- 172.21.15.31:0/2236552899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9140721a0 0x7fb914149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 >> 172.21.15.31:0/2236552899 conn(0x7fb91406db30 msgr2=0x7fb91406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 shutdown_connections 2024-03-23T23:56:45.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:45.901+0000 7fb919400640 1 -- 172.21.15.31:0/2236552899 wait complete. 2024-03-23T23:56:45.919 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T23:56:46.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.141+0000 7fe157e00640 1 Processor -- start 2024-03-23T23:56:46.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.142+0000 7fe157e00640 1 -- start start 2024-03-23T23:56:46.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe157e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1580b50a0 0x7fe158147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe157e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe1580b9810 0x7fe158141340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe157e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1580b9330 con 0x7fe1580b6b50 2024-03-23T23:56:46.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe157e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe158147660 con 0x7fe1580b9810 2024-03-23T23:56:46.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe157e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe158141880 con 0x7fe1580b50a0 2024-03-23T23:56:46.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe156000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe1580b6b50 0x7fe158140c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50084/0 (socket says 172.21.15.31:50084) 2024-03-23T23:56:46.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe156000640 1 -- 172.21.15.31:0/2219052500 learned_addr learned my addr 172.21.15.31:0/2219052500 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:46.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.143+0000 7fe157400640 1 --2- 172.21.15.31:0/2219052500 >> v2:172.21.15.31:3300/0 conn(0x7fe1580b9810 0x7fe158141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.144+0000 7fe156a00640 1 --2- 172.21.15.31:0/2219052500 >> v2:172.21.15.59:3300/0 conn(0x7fe1580b50a0 0x7fe158147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.144+0000 7fe155600640 1 -- 172.21.15.31:0/2219052500 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489348527 0 0) 0x7fe1580b9330 con 0x7fe1580b6b50 2024-03-23T23:56:46.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.144+0000 7fe157400640 1 -- 172.21.15.31:0/2219052500 >> v2:172.21.15.59:3300/0 conn(0x7fe1580b50a0 msgr2=0x7fe158147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:46.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.144+0000 7fe157400640 1 --2- 172.21.15.31:0/2219052500 >> v2:172.21.15.59:3300/0 conn(0x7fe1580b50a0 0x7fe158147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.144+0000 7fe157400640 1 -- 172.21.15.31:0/2219052500 >> v1:172.21.15.31:6789/0 conn(0x7fe1580b6b50 legacy=0x7fe158140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.144+0000 7fe157400640 1 -- 172.21.15.31:0/2219052500 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580b5480 con 0x7fe1580b9810 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.145+0000 7fe157400640 1 --2- 172.21.15.31:0/2219052500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b9810 0x7fe158141340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe15806e380 tx=0x7fe15002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1975fdc93cf9d484 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.145+0000 7fe155600640 1 -- 172.21.15.31:0/2219052500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500315a0 con 0x7fe1580b9810 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.145+0000 7fe155600640 1 -- 172.21.15.31:0/2219052500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150037070 con 0x7fe1580b9810 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.145+0000 7fe155600640 1 -- 172.21.15.31:0/2219052500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150031960 con 0x7fe1580b9810 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 -- 172.21.15.31:0/2219052500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b9810 msgr2=0x7fe158141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 --2- 172.21.15.31:0/2219052500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b9810 0x7fe158141340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe15806e380 tx=0x7fe15002b840 comp rx=0 tx=0).stop 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 -- 172.21.15.31:0/2219052500 shutdown_connections 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 --2- 172.21.15.31:0/2219052500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b9810 0x7fe158141340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 --2- 172.21.15.31:0/2219052500 >> v2:172.21.15.59:3300/0 conn(0x7fe1580b50a0 0x7fe158147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 -- 172.21.15.31:0/2219052500 >> 172.21.15.31:0/2219052500 conn(0x7fe158066dd0 msgr2=0x7fe1580671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:46.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 -- 172.21.15.31:0/2219052500 shutdown_connections 2024-03-23T23:56:46.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.146+0000 7fe157e00640 1 -- 172.21.15.31:0/2219052500 wait complete. 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 Processor -- start 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 -- start start 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1580b50a0 0x7fe15814b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b6b50 0x7fe1581dc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1580b9810 0x7fe1580b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b4000 con 0x7fe1580b6b50 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b63e0 con 0x7fe1580b9810 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.148+0000 7fe157e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b42e0 con 0x7fe1580b50a0 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b6b50 0x7fe1581dc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b6b50 0x7fe1581dc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40934/0 (socket says 172.21.15.31:40934) 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 -- 172.21.15.31:0/1972539814 learned_addr learned my addr 172.21.15.31:0/1972539814 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156a00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1580b50a0 0x7fe15814b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe157400640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1580b9810 0x7fe1580b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 -- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1580b50a0 msgr2=0x7fe15814b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1580b50a0 0x7fe15814b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 -- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1580b9810 msgr2=0x7fe1580b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1580b9810 0x7fe1580b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.149+0000 7fe156000640 1 -- 172.21.15.31:0/1972539814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580aa450 con 0x7fe1580b6b50 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.150+0000 7fe156000640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b6b50 0x7fe1581dc450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe14800cbe0 tx=0x7fe14800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.150+0000 7fe14ea00640 1 -- 172.21.15.31:0/1972539814 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148017070 con 0x7fe1580b6b50 2024-03-23T23:56:46.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.150+0000 7fe14ea00640 1 -- 172.21.15.31:0/1972539814 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14800ad00 con 0x7fe1580b6b50 2024-03-23T23:56:46.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.150+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1581dfb70 con 0x7fe1580b6b50 2024-03-23T23:56:46.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.150+0000 7fe14ea00640 1 -- 172.21.15.31:0/1972539814 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148012640 con 0x7fe1580b6b50 2024-03-23T23:56:46.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.150+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1581e0130 con 0x7fe1580b6b50 2024-03-23T23:56:46.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.151+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1580752c0 con 0x7fe1580b6b50 2024-03-23T23:56:46.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.152+0000 7fe14ea00640 1 -- 172.21.15.31:0/1972539814 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe14801a070 con 0x7fe1580b6b50 2024-03-23T23:56:46.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.154+0000 7fe14ea00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13406bc20 0x7fe13406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.154+0000 7fe14ea00640 1 -- 172.21.15.31:0/1972539814 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe14808a8d0 con 0x7fe1580b6b50 2024-03-23T23:56:46.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.154+0000 7fe156a00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13406bc20 0x7fe13406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.155+0000 7fe156a00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13406bc20 0x7fe13406e0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe140006fd0 tx=0x7fe140008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.159+0000 7fe14ea00640 1 -- 172.21.15.31:0/1972539814 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe148059430 con 0x7fe1580b6b50 2024-03-23T23:56:46.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.361+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1581468b0 con 0x7fe1580b6b50 2024-03-23T23:56:46.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.362+0000 7fe14ea00640 1 -- 172.21.15.31:0/1972539814 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe148058d30 con 0x7fe1580b6b50 2024-03-23T23:56:46.362 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-03-23T23:56:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13406bc20 msgr2=0x7fe13406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13406bc20 0x7fe13406e0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe140006fd0 tx=0x7fe140008040 comp rx=0 tx=0).stop 2024-03-23T23:56:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b6b50 msgr2=0x7fe1581dc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b6b50 0x7fe1581dc450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe14800cbe0 tx=0x7fe14800a430 comp rx=0 tx=0).stop 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 shutdown_connections 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe13406bc20 0x7fe13406e0e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1580b9810 0x7fe1580b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe1580b6b50 0x7fe1581dc450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 --2- 172.21.15.31:0/1972539814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1580b50a0 0x7fe15814b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 >> 172.21.15.31:0/1972539814 conn(0x7fe158066dd0 msgr2=0x7fe158145920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 shutdown_connections 2024-03-23T23:56:46.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.365+0000 7fe157e00640 1 -- 172.21.15.31:0/1972539814 wait complete. 2024-03-23T23:56:46.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:56:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.592+0000 7f3373e00640 1 Processor -- start 2024-03-23T23:56:46.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.592+0000 7f3373e00640 1 -- start start 2024-03-23T23:56:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3373e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33740b41b0 0x7f33740b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3373e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3374140e00 0x7f33741412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3373e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33740b4590 con 0x7f33740b6d30 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3373e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33740b56c0 con 0x7f33740b41b0 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3373e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33740b9930 con 0x7f3374140e00 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3372a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33740b41b0 0x7f33740b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3372a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33740b41b0 0x7f33740b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40948/0 (socket says 172.21.15.31:40948) 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.594+0000 7f3372a00640 1 -- 172.21.15.31:0/2278140014 learned_addr learned my addr 172.21.15.31:0/2278140014 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.595+0000 7f3372a00640 1 -- 172.21.15.31:0/2278140014 >> v2:172.21.15.59:3300/0 conn(0x7f3374140e00 msgr2=0x7f33741412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.595+0000 7f3372a00640 1 --2- 172.21.15.31:0/2278140014 >> v2:172.21.15.59:3300/0 conn(0x7f3374140e00 0x7f33741412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.595+0000 7f3372a00640 1 -- 172.21.15.31:0/2278140014 >> v1:172.21.15.59:6789/0 conn(0x7f33740b6d30 legacy=0x7f33741471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:46.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.595+0000 7f3372a00640 1 -- 172.21.15.31:0/2278140014 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33740b9c10 con 0x7f33740b41b0 2024-03-23T23:56:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.596+0000 7f3372a00640 1 --2- 172.21.15.31:0/2278140014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f33740b50a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33740b6210 tx=0x7f336402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bb8eff0e672bf9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.596+0000 7f3372000640 1 -- 172.21.15.31:0/2278140014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364035020 con 0x7f33740b41b0 2024-03-23T23:56:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.596+0000 7f3372000640 1 -- 172.21.15.31:0/2278140014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3364031870 con 0x7f33740b41b0 2024-03-23T23:56:46.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.596+0000 7f3372000640 1 -- 172.21.15.31:0/2278140014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364031c40 con 0x7f33740b41b0 2024-03-23T23:56:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 -- 172.21.15.31:0/2278140014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 msgr2=0x7f33740b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 --2- 172.21.15.31:0/2278140014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f33740b50a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33740b6210 tx=0x7f336402b910 comp rx=0 tx=0).stop 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 -- 172.21.15.31:0/2278140014 shutdown_connections 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 --2- 172.21.15.31:0/2278140014 >> v2:172.21.15.59:3300/0 conn(0x7f3374140e00 0x7f33741412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 --2- 172.21.15.31:0/2278140014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f33740b50a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 -- 172.21.15.31:0/2278140014 >> 172.21.15.31:0/2278140014 conn(0x7f3374066fb0 msgr2=0x7f33740673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 -- 172.21.15.31:0/2278140014 shutdown_connections 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.597+0000 7f3373e00640 1 -- 172.21.15.31:0/2278140014 wait complete. 2024-03-23T23:56:46.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.599+0000 7f3373e00640 1 Processor -- start 2024-03-23T23:56:46.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.599+0000 7f3373e00640 1 -- start start 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3373e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f337414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3373e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3374140e00 0x7f33741dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3373e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741e0490 0x7f33741e0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3373e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3374141970 con 0x7f33740b41b0 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3373e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33741417f0 con 0x7f33741e0490 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3373e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33741478f0 con 0x7f3374140e00 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f337414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f337414a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40958/0 (socket says 172.21.15.31:40958) 2024-03-23T23:56:46.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 -- 172.21.15.31:0/2039653508 learned_addr learned my addr 172.21.15.31:0/2039653508 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 -- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3374140e00 msgr2=0x7f33741dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3374140e00 0x7f33741dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 -- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741e0490 msgr2=0x7f33741e0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741e0490 0x7f33741e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.600+0000 7f3372a00640 1 -- 172.21.15.31:0/2039653508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33741dc9e0 con 0x7f33740b41b0 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.601+0000 7f3372a00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f337414a6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3364000c00 tx=0x7f33640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.601+0000 7f336b400640 1 -- 172.21.15.31:0/2039653508 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336403ad60 con 0x7f33740b41b0 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.601+0000 7f336b400640 1 -- 172.21.15.31:0/2039653508 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33640443f0 con 0x7f33740b41b0 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.601+0000 7f336b400640 1 -- 172.21.15.31:0/2039653508 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33640447e0 con 0x7f33740b41b0 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.601+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3374141e70 con 0x7f33740b41b0 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.601+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33741dcc60 con 0x7f33740b41b0 2024-03-23T23:56:46.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.603+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33740752c0 con 0x7f33740b41b0 2024-03-23T23:56:46.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.604+0000 7f336b400640 1 -- 172.21.15.31:0/2039653508 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f336404b060 con 0x7f33740b41b0 2024-03-23T23:56:46.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.604+0000 7f336b400640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f335006bbd0 0x7f335006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:46.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.604+0000 7f336b400640 1 -- 172.21.15.31:0/2039653508 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33640acc30 con 0x7f33740b41b0 2024-03-23T23:56:46.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.605+0000 7f336be00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f335006bbd0 0x7f335006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:46.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.606+0000 7f336be00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f335006bbd0 0x7f335006e090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f335c003cc0 tx=0x7f335c0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:46.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.609+0000 7f336b400640 1 -- 172.21.15.31:0/2039653508 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f33741dc9e0 con 0x7f33740b41b0 2024-03-23T23:56:46.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.847+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3374141b90 con 0x7f33740b41b0 2024-03-23T23:56:46.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.849+0000 7f336b400640 1 -- 172.21.15.31:0/2039653508 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3388 (secure 0 0 0) 0x7f336403f070 con 0x7f33740b41b0 2024-03-23T23:56:46.849 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:46.849 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/481677666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":481677666},{"type":"v1","addr":"172.21.15.31:6833","nonce":481677666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:56:30.337777+0000","modified":"2024-03-23T23:56:33.383201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3774186650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3774186650},{"type":"v1","addr":"172.21.15.59:6835","nonce":3774186650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-03-23T23:56:46.849 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-03-23T23:56:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f335006bbd0 msgr2=0x7f335006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f335006bbd0 0x7f335006e090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f335c003cc0 tx=0x7f335c0079b0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 msgr2=0x7f337414a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f337414a6a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3364000c00 tx=0x7f33640046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 shutdown_connections 2024-03-23T23:56:46.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f335006bbd0 0x7f335006e090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33741e0490 0x7f33741e0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3374140e00 0x7f33741dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 --2- 172.21.15.31:0/2039653508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33740b41b0 0x7f337414a6a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.851+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 >> 172.21.15.31:0/2039653508 conn(0x7f3374066fb0 msgr2=0x7f337413f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.852+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 shutdown_connections 2024-03-23T23:56:46.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:46.852+0000 7f3373e00640 1 -- 172.21.15.31:0/2039653508 wait complete. 2024-03-23T23:56:46.871 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:56:47.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.076+0000 7f38df200640 1 Processor -- start 2024-03-23T23:56:47.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.076+0000 7f38df200640 1 -- start start 2024-03-23T23:56:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.077+0000 7f38df200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f38d806b300 0x7f38d806b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.077+0000 7f38df200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d806b6e0 con 0x7f38d80b8ce0 2024-03-23T23:56:47.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.077+0000 7f38df200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d8071a10 con 0x7f38d80b9140 2024-03-23T23:56:47.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.077+0000 7f38df200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d806be70 con 0x7f38d806b300 2024-03-23T23:56:47.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d7400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f38d80b8ce0 0x7f38d8141140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50098/0 (socket says 172.21.15.31:50098) 2024-03-23T23:56:47.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d7400640 1 -- 172.21.15.31:0/3100474725 learned_addr learned my addr 172.21.15.31:0/3100474725 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:47.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d7e00640 1 --2- 172.21.15.31:0/3100474725 >> v2:172.21.15.31:3300/0 conn(0x7f38d806b300 0x7f38d806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d6a00640 1 -- 172.21.15.31:0/3100474725 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229130359 0 0) 0x7f38d806b6e0 con 0x7f38d80b8ce0 2024-03-23T23:56:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d6a00640 1 -- 172.21.15.31:0/3100474725 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38bc003520 con 0x7f38d80b8ce0 2024-03-23T23:56:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d7e00640 1 -- 172.21.15.31:0/3100474725 >> v1:172.21.15.59:6789/0 conn(0x7f38d80b9140 legacy=0x7f38d8151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d7e00640 1 -- 172.21.15.31:0/3100474725 >> v1:172.21.15.31:6789/0 conn(0x7f38d80b8ce0 legacy=0x7f38d8141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.078+0000 7f38d7e00640 1 -- 172.21.15.31:0/3100474725 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d8071cf0 con 0x7f38d806b300 2024-03-23T23:56:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.079+0000 7f38d7e00640 1 --2- 172.21.15.31:0/3100474725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d806b300 0x7f38d806b930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38c00097a0 tx=0x7f38c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09f96ba9846ba0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:47.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38d6a00640 1 -- 172.21.15.31:0/3100474725 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0035020 con 0x7f38d806b300 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38d6a00640 1 -- 172.21.15.31:0/3100474725 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0031830 con 0x7f38d806b300 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38d6a00640 1 -- 172.21.15.31:0/3100474725 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0031be0 con 0x7f38d806b300 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38df200640 1 -- 172.21.15.31:0/3100474725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d806b300 msgr2=0x7f38d806b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38df200640 1 --2- 172.21.15.31:0/3100474725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d806b300 0x7f38d806b930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f38c00097a0 tx=0x7f38c002b8d0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38df200640 1 -- 172.21.15.31:0/3100474725 shutdown_connections 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38df200640 1 --2- 172.21.15.31:0/3100474725 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d806b300 0x7f38d806b930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38df200640 1 -- 172.21.15.31:0/3100474725 >> 172.21.15.31:0/3100474725 conn(0x7f38d80b9890 msgr2=0x7f38d80b9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38df200640 1 -- 172.21.15.31:0/3100474725 shutdown_connections 2024-03-23T23:56:47.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.080+0000 7f38df200640 1 -- 172.21.15.31:0/3100474725 wait complete. 2024-03-23T23:56:47.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.082+0000 7f38df200640 1 Processor -- start 2024-03-23T23:56:47.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.082+0000 7f38df200640 1 -- start start 2024-03-23T23:56:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38df200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38d806b300 0x7f38d80afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38df200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d80b8ce0 0x7f38d81e0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38df200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d80b9140 0x7f38d8139b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38df200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d806c090 con 0x7f38d80b9140 2024-03-23T23:56:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38df200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d8071450 con 0x7f38d80b8ce0 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38df200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80729b0 con 0x7f38d806b300 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38dd200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d80b9140 0x7f38d8139b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38dd200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d80b9140 0x7f38d8139b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40976/0 (socket says 172.21.15.31:40976) 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38dd200640 1 -- 172.21.15.31:0/2067398693 learned_addr learned my addr 172.21.15.31:0/2067398693 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.083+0000 7f38d7400640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d80b8ce0 0x7f38d81e0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38dd200640 1 -- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38d806b300 msgr2=0x7f38d80afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38d7e00640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38d806b300 0x7f38d80afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38dd200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38d806b300 0x7f38d80afdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38dd200640 1 -- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d80b8ce0 msgr2=0x7f38d81e0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38dd200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d80b8ce0 0x7f38d81e0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38dd200640 1 -- 172.21.15.31:0/2067398693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d8143080 con 0x7f38d80b9140 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38d7400640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d80b8ce0 0x7f38d81e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:47.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38dd200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d80b9140 0x7f38d8139b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c680 tx=0x7f38d000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38cfe00640 1 -- 172.21.15.31:0/2067398693 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0003b70 con 0x7f38d80b9140 2024-03-23T23:56:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38cfe00640 1 -- 172.21.15.31:0/2067398693 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d0003d10 con 0x7f38d80b9140 2024-03-23T23:56:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38cfe00640 1 -- 172.21.15.31:0/2067398693 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0005310 con 0x7f38d80b9140 2024-03-23T23:56:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d8148170 con 0x7f38d80b9140 2024-03-23T23:56:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.084+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d8145470 con 0x7f38d80b9140 2024-03-23T23:56:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.086+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d804f400 con 0x7f38d80b9140 2024-03-23T23:56:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.086+0000 7f38cfe00640 1 -- 172.21.15.31:0/2067398693 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f38d00054b0 con 0x7f38d80b9140 2024-03-23T23:56:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.087+0000 7f38cfe00640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f38b406bbd0 0x7f38b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.087+0000 7f38cfe00640 1 -- 172.21.15.31:0/2067398693 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38d008a8d0 con 0x7f38d80b9140 2024-03-23T23:56:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.088+0000 7f38d7e00640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f38b406bbd0 0x7f38b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.089+0000 7f38d7e00640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f38b406bbd0 0x7f38b406e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38c0036000 tx=0x7f38c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:47.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.092+0000 7f38cfe00640 1 -- 172.21.15.31:0/2067398693 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f38d00593b0 con 0x7f38d80b9140 2024-03-23T23:56:47.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.294+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38d813fb30 con 0x7f38d80b9140 2024-03-23T23:56:47.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.296+0000 7f38cfe00640 1 -- 172.21.15.31:0/2067398693 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16533 (secure 0 0 0) 0x7f38d0058cb0 con 0x7f38d80b9140 2024-03-23T23:56:47.296 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:47.296 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:56:31.864837+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f38b406bbd0 msgr2=0x7f38b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f38b406bbd0 0x7f38b406e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38c0036000 tx=0x7f38c0008030 comp rx=0 tx=0).stop 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d80b9140 msgr2=0x7f38d8139b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d80b9140 0x7f38d8139b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f38d000c680 tx=0x7f38d000cb40 comp rx=0 tx=0).stop 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 shutdown_connections 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f38b406bbd0 0x7f38b406e090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38d80b8ce0 0x7f38d81e0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f38d80b9140 0x7f38d8139b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 --2- 172.21.15.31:0/2067398693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f38d806b300 0x7f38d80afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.298+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 >> 172.21.15.31:0/2067398693 conn(0x7f38d80b9890 msgr2=0x7f38d8140050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.299+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 shutdown_connections 2024-03-23T23:56:47.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.299+0000 7f38df200640 1 -- 172.21.15.31:0/2067398693 wait complete. 2024-03-23T23:56:47.319 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:56:47.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.540+0000 7f4ec5000640 1 Processor -- start 2024-03-23T23:56:47.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.540+0000 7f4ec5000640 1 -- start start 2024-03-23T23:56:47.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.541+0000 7f4ec5000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec00b88b0 0x7f4ec00b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.541+0000 7f4ec5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ec0149060 0x7f4ec01427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.541+0000 7f4ec5000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec00b8c90 con 0x7f4ec0142380 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.541+0000 7f4ec5000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec00b4f60 con 0x7f4ec00b88b0 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.541+0000 7f4ec5000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec00b49a0 con 0x7f4ec0149060 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebf400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec00b88b0 0x7f4ec00b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebf400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4ec00b88b0 0x7f4ec00b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40978/0 (socket says 172.21.15.31:40978) 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebf400640 1 -- 172.21.15.31:0/1723264688 learned_addr learned my addr 172.21.15.31:0/1723264688 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebfe00640 1 --2- 172.21.15.31:0/1723264688 >> v2:172.21.15.59:3300/0 conn(0x7f4ec0149060 0x7f4ec01427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebf400640 1 -- 172.21.15.31:0/1723264688 >> v2:172.21.15.59:3300/0 conn(0x7f4ec0149060 msgr2=0x7f4ec01427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebf400640 1 --2- 172.21.15.31:0/1723264688 >> v2:172.21.15.59:3300/0 conn(0x7f4ec0149060 0x7f4ec01427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebf400640 1 -- 172.21.15.31:0/1723264688 >> v1:172.21.15.59:6789/0 conn(0x7f4ec0142380 legacy=0x7f4ec0148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.542+0000 7f4ebf400640 1 -- 172.21.15.31:0/1723264688 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00b4c80 con 0x7f4ec00b88b0 2024-03-23T23:56:47.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.544+0000 7f4ebf400640 1 --2- 172.21.15.31:0/1723264688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec00b4160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0073870 tx=0x7f4eb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa817aef8b72ba5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:47.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.544+0000 7f4ebe000640 1 -- 172.21.15.31:0/1723264688 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0035020 con 0x7f4ec00b88b0 2024-03-23T23:56:47.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.544+0000 7f4ebe000640 1 -- 172.21.15.31:0/1723264688 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb0031870 con 0x7f4ec00b88b0 2024-03-23T23:56:47.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.544+0000 7f4ebe000640 1 -- 172.21.15.31:0/1723264688 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0031c40 con 0x7f4ec00b88b0 2024-03-23T23:56:47.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 -- 172.21.15.31:0/1723264688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 msgr2=0x7f4ec00b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 --2- 172.21.15.31:0/1723264688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec00b4160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0073870 tx=0x7f4eb002b910 comp rx=0 tx=0).stop 2024-03-23T23:56:47.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 -- 172.21.15.31:0/1723264688 shutdown_connections 2024-03-23T23:56:47.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 --2- 172.21.15.31:0/1723264688 >> v2:172.21.15.59:3300/0 conn(0x7f4ec0149060 0x7f4ec01427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 --2- 172.21.15.31:0/1723264688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec00b4160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 -- 172.21.15.31:0/1723264688 >> 172.21.15.31:0/1723264688 conn(0x7f4ec006cf40 msgr2=0x7f4ec006ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:47.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 -- 172.21.15.31:0/1723264688 shutdown_connections 2024-03-23T23:56:47.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.545+0000 7f4ec5000640 1 -- 172.21.15.31:0/1723264688 wait complete. 2024-03-23T23:56:47.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.547+0000 7f4ec5000640 1 Processor -- start 2024-03-23T23:56:47.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.547+0000 7f4ec5000640 1 -- start start 2024-03-23T23:56:47.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ec5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec0144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ec5000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0142380 0x7f4ec01d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ec5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec0149060 0x7f4ec01d8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ec5000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00b9490 con 0x7f4ec00b88b0 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ec5000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00b46a0 con 0x7f4ec0149060 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ec5000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec00ad6d0 con 0x7f4ec0142380 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec0144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec0144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40982/0 (socket says 172.21.15.31:40982) 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ebf400640 1 -- 172.21.15.31:0/493340632 learned_addr learned my addr 172.21.15.31:0/493340632 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ebea00640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0142380 0x7f4ec01d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.548+0000 7f4ebfe00640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec0149060 0x7f4ec01d8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ebf400640 1 -- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0142380 msgr2=0x7f4ec01d88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ebf400640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0142380 0x7f4ec01d88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ebf400640 1 -- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec0149060 msgr2=0x7f4ec01d8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ebf400640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec0149060 0x7f4ec01d8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ebf400640 1 -- 172.21.15.31:0/493340632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00af2c0 con 0x7f4ec00b88b0 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ebf400640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec0144780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4eb002b950 tx=0x7f4eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4eb7400640 1 -- 172.21.15.31:0/493340632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0040070 con 0x7f4ec00b88b0 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4eb7400640 1 -- 172.21.15.31:0/493340632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb0030d00 con 0x7f4ec00b88b0 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec0143ff0 con 0x7f4ec00b88b0 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4eb7400640 1 -- 172.21.15.31:0/493340632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0035040 con 0x7f4ec00b88b0 2024-03-23T23:56:47.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.549+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec0144cc0 con 0x7f4ec00b88b0 2024-03-23T23:56:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.551+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec00ad880 con 0x7f4ec00b88b0 2024-03-23T23:56:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.552+0000 7f4eb7400640 1 -- 172.21.15.31:0/493340632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4eb004b060 con 0x7f4ec00b88b0 2024-03-23T23:56:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.552+0000 7f4eb7400640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4ea006bbd0 0x7f4ea006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:47.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.553+0000 7f4eb7400640 1 -- 172.21.15.31:0/493340632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4eb00ac790 con 0x7f4ec00b88b0 2024-03-23T23:56:47.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.553+0000 7f4ebea00640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4ea006bbd0 0x7f4ea006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:47.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.554+0000 7f4ebea00640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4ea006bbd0 0x7f4ea006e090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007fd0 tx=0x7f4eac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:47.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.557+0000 7f4eb7400640 1 -- 172.21.15.31:0/493340632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4ec00ad880 con 0x7f4ec00b88b0 2024-03-23T23:56:47.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.800+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ec00752c0 con 0x7f4ec00b88b0 2024-03-23T23:56:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.801+0000 7f4eb7400640 1 -- 172.21.15.31:0/493340632 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3388 (secure 0 0 0) 0x7f4eb007b270 con 0x7f4ec00b88b0 2024-03-23T23:56:47.801 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:56:47.801 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/481677666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":481677666},{"type":"v1","addr":"172.21.15.31:6833","nonce":481677666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:56:30.337777+0000","modified":"2024-03-23T23:56:33.383201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3774186650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3774186650},{"type":"v1","addr":"172.21.15.59:6835","nonce":3774186650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-03-23T23:56:47.801 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-03-23T23:56:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4ea006bbd0 msgr2=0x7f4ea006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4ea006bbd0 0x7f4ea006e090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007fd0 tx=0x7f4eac009040 comp rx=0 tx=0).stop 2024-03-23T23:56:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 msgr2=0x7f4ec0144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec0144780 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4eb002b950 tx=0x7f4eb00046c0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 shutdown_connections 2024-03-23T23:56:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4ea006bbd0 0x7f4ea006e090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec0149060 0x7f4ec01d8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec0142380 0x7f4ec01d88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 --2- 172.21.15.31:0/493340632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4ec00b88b0 0x7f4ec0144780 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:47.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 >> 172.21.15.31:0/493340632 conn(0x7f4ec006cf40 msgr2=0x7f4ec00b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:47.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 shutdown_connections 2024-03-23T23:56:47.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:47.804+0000 7f4ec5000640 1 -- 172.21.15.31:0/493340632 wait complete. 2024-03-23T23:56:48.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-23T23:56:30.337777+0000', 'modified': '2024-03-23T23:56:33.383201+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/3774186650', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 3774186650}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 3774186650}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4272, 'qdb_cluster': [4272]} 2024-03-23T23:56:48.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-23T23:56:48.024 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-23T23:56:48.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.248+0000 7fc7c8400640 1 Processor -- start 2024-03-23T23:56:48.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.249+0000 7fc7c8400640 1 -- start start 2024-03-23T23:56:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.250+0000 7fc7c8400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 0x7fc7c00af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.250+0000 7fc7c8400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00ae7e0 con 0x7fc7c014aa40 2024-03-23T23:56:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.250+0000 7fc7c8400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00b5b60 con 0x7fc7c00b4e00 2024-03-23T23:56:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.250+0000 7fc7c8400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b4970 con 0x7fc7c00b5780 2024-03-23T23:56:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.250+0000 7fc7c6400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc7c014aa40 0x7fc7c0147620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:50100/0 (socket says 172.21.15.31:50100) 2024-03-23T23:56:48.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.250+0000 7fc7c6400640 1 -- 172.21.15.31:0/1955326856 learned_addr learned my addr 172.21.15.31:0/1955326856 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:56:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 0x7fc7c00af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433668989 0 0) 0x7fc7c00ae7e0 con 0x7fc7c014aa40 2024-03-23T23:56:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7a4003520 con 0x7fc7c014aa40 2024-03-23T23:56:48.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852575360 0 0) 0x7fc7a4003520 con 0x7fc7c014aa40 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 msgr2=0x7fc7c00af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 0x7fc7c00af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 >> v1:172.21.15.59:6789/0 conn(0x7fc7c00b4e00 legacy=0x7fc7c00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00aea80 con 0x7fc7c014aa40 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fc7b8001690 con 0x7fc7c014aa40 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 >> v1:172.21.15.31:6789/0 conn(0x7fc7c014aa40 legacy=0x7fc7c0147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 0x7fc7a40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a4003f60 0x7fc7a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4004d40 0x7fc7a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00b4970 con 0x7fc7a4003f60 2024-03-23T23:56:48.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a400bc00 con 0x7fc7a4004d40 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.251+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a400be00 con 0x7fc7c00b5780 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c5000640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a4003f60 0x7fc7a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 0x7fc7a40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c6400640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4004d40 0x7fc7a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c5000640 1 -- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 msgr2=0x7fc7a40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c5000640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c00b5780 0x7fc7a40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c5000640 1 -- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4004d40 msgr2=0x7fc7a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c5000640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4004d40 0x7fc7a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c5000640 1 -- 172.21.15.31:0/1955326856 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4003520 con 0x7fc7a4003f60 2024-03-23T23:56:48.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.252+0000 7fc7c6400640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4004d40 0x7fc7a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.253+0000 7fc7c5000640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a4003f60 0x7fc7a4004800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac001e50 tx=0x7fc7a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a6638fc70e9135 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.253+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac001a70 con 0x7fc7a4003f60 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.253+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac003b70 con 0x7fc7a4003f60 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.253+0000 7fc7bfe00640 1 -- 172.21.15.31:0/1955326856 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0050d0 con 0x7fc7a4003f60 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.254+0000 7fc7c8400640 1 -- 172.21.15.31:0/1955326856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a4003f60 msgr2=0x7fc7a4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.254+0000 7fc7c8400640 1 --2- 172.21.15.31:0/1955326856 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7a4003f60 0x7fc7a4004800 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac001e50 tx=0x7fc7a4005830 comp rx=0 tx=0).stop 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.254+0000 7fc7c6400640 1 -- 172.21.15.31:0/1955326856 reap_dead start 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.254+0000 7fc7c8400640 1 -- 172.21.15.31:0/1955326856 shutdown_connections 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.254+0000 7fc7c8400640 1 -- 172.21.15.31:0/1955326856 >> 172.21.15.31:0/1955326856 conn(0x7fc7c0066fe0 msgr2=0x7fc7c00673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:48.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.254+0000 7fc7c8400640 1 -- 172.21.15.31:0/1955326856 shutdown_connections 2024-03-23T23:56:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.254+0000 7fc7c8400640 1 -- 172.21.15.31:0/1955326856 wait complete. 2024-03-23T23:56:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.256+0000 7fc7c8400640 1 Processor -- start 2024-03-23T23:56:48.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.256+0000 7fc7c8400640 1 -- start start 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c8400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4003f60 0x7fc7c013f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c8400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7c013da40 0x7fc7c013dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c8400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c01dd4b0 0x7fc7c01dd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c8400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00af750 con 0x7fc7c013da40 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c8400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00af5d0 con 0x7fc7a4003f60 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c8400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00af8d0 con 0x7fc7c01dd4b0 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7c013da40 0x7fc7c013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7c013da40 0x7fc7c013dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41004/0 (socket says 172.21.15.31:41004) 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c5000640 1 -- 172.21.15.31:0/2107261379 learned_addr learned my addr 172.21.15.31:0/2107261379 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4003f60 0x7fc7c013f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.257+0000 7fc7c6400640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c01dd4b0 0x7fc7c01dd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c5000640 1 -- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c01dd4b0 msgr2=0x7fc7c01dd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c5000640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c01dd4b0 0x7fc7c01dd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c5000640 1 -- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4003f60 msgr2=0x7fc7c013f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c5000640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4003f60 0x7fc7c013f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c5000640 1 -- 172.21.15.31:0/2107261379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c01ddea0 con 0x7fc7c013da40 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4003f60 0x7fc7c013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c5000640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7c013da40 0x7fc7c013dec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac001f70 tx=0x7fc7ac0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7bd600640 1 -- 172.21.15.31:0/2107261379 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac003970 con 0x7fc7c013da40 2024-03-23T23:56:48.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7bd600640 1 -- 172.21.15.31:0/2107261379 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac006b50 con 0x7fc7c013da40 2024-03-23T23:56:48.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7bd600640 1 -- 172.21.15.31:0/2107261379 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac007030 con 0x7fc7c013da40 2024-03-23T23:56:48.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c00b8440 con 0x7fc7c013da40 2024-03-23T23:56:48.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.258+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c0140bb0 con 0x7fc7c013da40 2024-03-23T23:56:48.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.261+0000 7fc7bd600640 1 -- 172.21.15.31:0/2107261379 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc7ac0071d0 con 0x7fc7c013da40 2024-03-23T23:56:48.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.262+0000 7fc7bd600640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc7a006bbd0 0x7fc7a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.262+0000 7fc7bd600640 1 -- 172.21.15.31:0/2107261379 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7ac0ac690 con 0x7fc7c013da40 2024-03-23T23:56:48.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.263+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc7a006bbd0 0x7fc7a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.263+0000 7fc7cb193740 1 Processor -- start 2024-03-23T23:56:48.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.263+0000 7fc7cb193740 1 -- start start 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5638980425c0 0x56389806ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980666f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898066c30 0x563898071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7cb193740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563897fa7c90 con 0x5638980425c0 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563897f50980 con 0x563898066c30 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563897fa3d30 con 0x56389806b2a0 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc7a006bbd0 0x7fc7a006e090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00b8040 tx=0x7fc7b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5638980425c0 0x56389806ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5638980425c0 0x56389806ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41020/0 (socket says 172.21.15.31:41020) 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 -- 172.21.15.31:0/298974644 learned_addr learned my addr 172.21.15.31:0/298974644 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c6400640 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898066c30 0x563898071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5000640 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 -- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 msgr2=0x5638980666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980666f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 -- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898066c30 msgr2=0x563898071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.264+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898066c30 0x563898071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.265+0000 7fc7c5a00640 1 -- 172.21.15.31:0/298974644 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563897f68510 con 0x5638980425c0 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.265+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5638980425c0 0x56389806ad60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0012d50 tx=0x7fc7b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af17b891c06d89a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.265+0000 7fc7b6000640 1 -- 172.21.15.31:0/298974644 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0022440 con 0x5638980425c0 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.265+0000 7fc7b6000640 1 -- 172.21.15.31:0/298974644 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b0027070 con 0x5638980425c0 2024-03-23T23:56:48.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.265+0000 7fc7b6000640 1 -- 172.21.15.31:0/298974644 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b00227e0 con 0x5638980425c0 2024-03-23T23:56:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 -- 172.21.15.31:0/298974644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5638980425c0 msgr2=0x56389806ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5638980425c0 0x56389806ad60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0012d50 tx=0x7fc7b0015000 comp rx=0 tx=0).stop 2024-03-23T23:56:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 -- 172.21.15.31:0/298974644 shutdown_connections 2024-03-23T23:56:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898066c30 0x563898071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 --2- 172.21.15.31:0/298974644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5638980425c0 0x56389806ad60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 -- 172.21.15.31:0/298974644 >> 172.21.15.31:0/298974644 conn(0x56389803fb90 msgr2=0x563898041b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 -- 172.21.15.31:0/298974644 shutdown_connections 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.266+0000 7fc7cb193740 1 -- 172.21.15.31:0/298974644 wait complete. 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.267+0000 7fc7cb193740 1 -- start start 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.267+0000 7fc7cb193740 1 Processor -- start 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x563898062180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898081950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7cb193740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389806b720 con 0x563898066c30 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563897f63dd0 con 0x563898084f00 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563898071330 con 0x56389806b2a0 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7cb193740 10 client.0 _ll_register_callbacks cb 0x563897cbbac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x563898062180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x563898062180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41036/0 (socket says 172.21.15.31:41036) 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 -- 172.21.15.31:0/3118489937 learned_addr learned my addr 172.21.15.31:0/3118489937 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5000640 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c6400640 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898081950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 -- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 msgr2=0x5638980626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980626c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 -- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 msgr2=0x563898081950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898081950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.268+0000 7fc7c5a00640 1 -- 172.21.15.31:0/3118489937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563897cbc2d0 con 0x563898066c30 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x563898062180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009800 tx=0x7fc7b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801125d7cb5485b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7aaa00640 1 -- 172.21.15.31:0/3118489937 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0039060 con 0x563898066c30 2024-03-23T23:56:48.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7aaa00640 1 -- 172.21.15.31:0/3118489937 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7b0022af0 con 0x563898066c30 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7b0027070 con 0x563898066c30 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7aaa00640 1 -- 172.21.15.31:0/3118489937 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7b003f050 con 0x563898066c30 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7cb193740 10 client.4650 fetch_fsmap learned FSMap version 8 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.269+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563897d866b0 con 0x563898066c30 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7aaa00640 1 -- 172.21.15.31:0/3118489937 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b0027070 con 0x563898066c30 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7aaa00640 1 -- 172.21.15.31:0/3118489937 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) v1 ==== 2164+0+0 (secure 0 0 0) 0x7fc7b0042020 con 0x563898066c30 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7cb193740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7cb193740 10 client.4650 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7cb193740 20 client.4650 populate_metadata read hostname 'smithi031' 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7cb193740 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x56389806de50 0x563898082360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7cb193740 4 client.4650 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563897f49520 con 0x56389806de50 2024-03-23T23:56:48.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.270+0000 7fc7c5000640 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x56389806de50 0x563898082360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.271+0000 7fc7c5000640 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x56389806de50 0x563898082360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=319afbdaa5ae52d7 server_cookie=1a08a3e3725d269e in_seq=0 out_seq=0 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.271+0000 7fc7aaa00640 10 client.4650 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7aaa00640 1 -- 172.21.15.31:0/3118489937 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563897f49520 con 0x56389806de50 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7aaa00640 10 client.4650 handle_command_reply: tid=0 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 client.4650 shutdown 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 msgr2=0x563898062180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x563898062180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009800 tx=0x7fc7b0004730 comp rx=0 tx=0).stop 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 shutdown_connections 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x56389806de50 0x563898082360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898081950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x5638980626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 --2- 172.21.15.31:0/3118489937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x563898062180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7aaa00640 0 client.4650 ms_handle_reset on v2:172.21.15.59:6834/3774186650 2024-03-23T23:56:48.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 >> 172.21.15.31:0/3118489937 conn(0x5638980425c0 msgr2=0x5638980429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:48.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.273+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 shutdown_connections 2024-03-23T23:56:48.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.274+0000 7fc7cb193740 1 -- 172.21.15.31:0/3118489937 wait complete. 2024-03-23T23:56:48.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.274+0000 7fc7cb193740 20 client.4650 trim_cache size 0 max 16384 2024-03-23T23:56:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.292+0000 7fc7cb193740 1 Processor -- start 2024-03-23T23:56:48.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.292+0000 7fc7cb193740 1 -- start start 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563898066c30 0x563898066290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56389806b2a0 0x563898084370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898084f00 0x5638980848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7cb193740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01ea000 con 0x563898084f00 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c01e92e0 con 0x56389806b2a0 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563898085460 con 0x563898066c30 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7c6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898084f00 0x5638980848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7c6400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898084f00 0x5638980848b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41048/0 (socket says 172.21.15.31:41048) 2024-03-23T23:56:48.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7c6400640 1 -- 172.21.15.31:0/1211205043 learned_addr learned my addr 172.21.15.31:0/1211205043 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563898066c30 0x563898066290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.293+0000 7fc7c5000640 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56389806b2a0 0x563898084370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7c6400640 1 -- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563898066c30 msgr2=0x563898066290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7c6400640 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563898066c30 0x563898066290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7c6400640 1 -- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56389806b2a0 msgr2=0x563898084370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7c6400640 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56389806b2a0 0x563898084370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7c6400640 1 -- 172.21.15.31:0/1211205043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389803f930 con 0x563898084f00 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7c6400640 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898084f00 0x5638980848b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00b4600 tx=0x7fc7b8007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f766ced29f915041 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7b5600640 1 -- 172.21.15.31:0/1211205043 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80070d0 con 0x563898084f00 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7b5600640 1 -- 172.21.15.31:0/1211205043 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8007290 con 0x563898084f00 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.294+0000 7fc7b5600640 1 -- 172.21.15.31:0/1211205043 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80047e0 con 0x563898084f00 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 -- 172.21.15.31:0/1211205043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898084f00 msgr2=0x5638980848b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898084f00 0x5638980848b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00b4600 tx=0x7fc7b8007be0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 -- 172.21.15.31:0/1211205043 shutdown_connections 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56389806b2a0 0x563898084370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898084f00 0x5638980848b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 --2- 172.21.15.31:0/1211205043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563898066c30 0x563898066290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 -- 172.21.15.31:0/1211205043 >> 172.21.15.31:0/1211205043 conn(0x5638980425c0 msgr2=0x563898067010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:48.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 -- 172.21.15.31:0/1211205043 shutdown_connections 2024-03-23T23:56:48.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.295+0000 7fc7cb193740 1 -- 172.21.15.31:0/1211205043 wait complete. 2024-03-23T23:56:48.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.296+0000 7fc7cb193740 1 -- start start 2024-03-23T23:56:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.296+0000 7fc7cb193740 1 Processor -- start 2024-03-23T23:56:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x56389806c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x563898094800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7cb193740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898062db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7cb193740 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x563898064810 con 0x563898066c30 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638980399b0 con 0x563898084f00 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7cb193740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563898094fc0 con 0x56389806b2a0 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7cb193740 10 client.0 _ll_register_callbacks cb 0x7fc7b0012bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x56389806c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x56389806c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41050/0 (socket says 172.21.15.31:41050) 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 -- 172.21.15.31:0/915223691 learned_addr learned my addr 172.21.15.31:0/915223691 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 -- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 msgr2=0x563898094800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x563898094800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c6400640 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898062db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 -- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 msgr2=0x563898062db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:56:48.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898062db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.297+0000 7fc7c5a00640 1 -- 172.21.15.31:0/915223691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563898061de0 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7c5a00640 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x56389806c500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0037040 tx=0x7fc7b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfda56f02ff2ee server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7aaa00640 1 -- 172.21.15.31:0/915223691 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0048060 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7aaa00640 1 -- 172.21.15.31:0/915223691 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7b00347f0 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7b8007290 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7aaa00640 1 -- 172.21.15.31:0/915223691 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7b004e050 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7cb193740 10 client.4656 fetch_fsmap learned FSMap version 8 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x56389806aae0 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7aaa00640 1 -- 172.21.15.31:0/915223691 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b8007290 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.298+0000 7fc7aaa00640 1 -- 172.21.15.31:0/915223691 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) v1 ==== 2164+0+0 (secure 0 0 0) 0x7fc7b0051020 con 0x563898066c30 2024-03-23T23:56:48.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.299+0000 7fc7cb193740 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2024-03-23T23:56:48.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.299+0000 7fc7cb193740 10 client.4656 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-23T23:56:48.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.299+0000 7fc7cb193740 20 client.4656 populate_metadata read hostname 'smithi031' 2024-03-23T23:56:48.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.299+0000 7fc7cb193740 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x563898063960 0x5638980dd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:56:48.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.299+0000 7fc7cb193740 4 client.4656 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-23T23:56:48.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.299+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563897fb51d0 con 0x563898063960 2024-03-23T23:56:48.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.299+0000 7fc7c5000640 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x563898063960 0x5638980dd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:56:48.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.300+0000 7fc7c5000640 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x563898063960 0x5638980dd260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cfae281626f75f7 server_cookie=220de979f67f4fd9 in_seq=0 out_seq=0 2024-03-23T23:56:48.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.300+0000 7fc7aaa00640 10 client.4656 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:56:48.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7aaa00640 1 -- 172.21.15.31:0/915223691 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563897fb51d0 con 0x563898063960 2024-03-23T23:56:48.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7aaa00640 10 client.4656 handle_command_reply: tid=0 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 client.4656 shutdown 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 msgr2=0x56389806c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x56389806c500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0037040 tx=0x7fc7b0018000 comp rx=0 tx=0).stop 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 shutdown_connections 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x563898063960 0x5638980dd260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563898084f00 0x563898062db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x56389806b2a0 0x563898094800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 --2- 172.21.15.31:0/915223691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x563898066c30 0x56389806c500 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 >> 172.21.15.31:0/915223691 conn(0x5638980425c0 msgr2=0x563898066260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7aaa00640 0 client.4656 ms_handle_reset on v2:172.21.15.59:6834/3774186650 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 shutdown_connections 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 1 -- 172.21.15.31:0/915223691 wait complete. 2024-03-23T23:56:48.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.301+0000 7fc7cb193740 20 client.4656 trim_cache size 0 max 16384 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "6654f0f5-f55e-4e42-bb02-030326afa81f", 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4272, 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 17.435804392000001, 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 8, 2024-03-23T23:56:48.305 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 21, 2024-03-23T23:56:48.306 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 21, 2024-03-23T23:56:48.306 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 23.548048440999999 2024-03-23T23:56:48.306 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:56:48.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc7a006bbd0 msgr2=0x7fc7a006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc7a006bbd0 0x7fc7a006e090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00b8040 tx=0x7fc7b0008040 comp rx=0 tx=0).stop 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7c013da40 msgr2=0x7fc7c013dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7c013da40 0x7fc7c013dec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac001f70 tx=0x7fc7ac0014a0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 shutdown_connections 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fc7a006bbd0 0x7fc7a006e090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7c01dd4b0 0x7fc7c01dd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7c013da40 0x7fc7c013dec0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 --2- 172.21.15.31:0/2107261379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7a4003f60 0x7fc7c013f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 >> 172.21.15.31:0/2107261379 conn(0x7fc7c0066fe0 msgr2=0x7fc7c00673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 shutdown_connections 2024-03-23T23:56:48.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:56:48.302+0000 7fc7c8400640 1 -- 172.21.15.31:0/2107261379 wait complete. 2024-03-23T23:56:48.319 INFO:teuthology.run_tasks:Running task workunit... 2024-03-23T23:56:48.334 INFO:tasks.workunit:Pulling workunits from ref 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:56:48.334 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-23T23:56:48.335 DEBUG:teuthology.orchestra.run.smithi031:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-23T23:56:48.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:56:48.383 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-23T23:56:48.384 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-23T23:56:48.436 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-23T23:56:48.436 DEBUG:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-23T23:56:48.492 INFO:tasks.workunit:timeout=3h 2024-03-23T23:56:48.492 INFO:tasks.workunit:cleanup=True 2024-03-23T23:56:48.493 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3be9a5c9bc793e11e2800a8c0c696e8b46742033 2024-03-23T23:56:48.551 INFO:tasks.workunit.client.0.smithi031.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-23T23:57:15.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:15.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:45.239 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:57:45.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:10.573 INFO:tasks.workunit.client.0.smithi031.stderr:Updating files: 62% (7626/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr:Note: switching to '3be9a5c9bc793e11e2800a8c0c696e8b46742033'. 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr:state without impacting any branches by switching back to a branch. 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-23T23:58:11.217 INFO:tasks.workunit.client.0.smithi031.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr: git switch -c 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr:Or undo this operation with: 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr: git switch - 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr: 2024-03-23T23:58:11.218 INFO:tasks.workunit.client.0.smithi031.stderr:HEAD is now at 3be9a5c9bc7 dummy commit #1 2024-03-23T23:58:11.226 DEBUG:teuthology.orchestra.run.smithi031:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-23T23:58:11.291 INFO:tasks.workunit.client.0.smithi031.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-23T23:58:11.298 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-23T23:58:11.299 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-23T23:58:12.109 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-23T23:58:12.250 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-23T23:58:12.330 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-23T23:58:12.338 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-23T23:58:12.338 INFO:tasks.workunit.client.0.smithi031.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-23T23:58:12.424 INFO:tasks.workunit.client.0.smithi031.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-23T23:58:12.432 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-03-23T23:58:12.432 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-23T23:58:12.487 INFO:tasks.workunit:Running workunits matching client/test.sh on client.0... 2024-03-23T23:58:12.489 INFO:tasks.workunit:Running workunit client/test.sh... 2024-03-23T23:58:12.489 DEBUG:teuthology.orchestra.run.smithi031:workunit test client/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh 2024-03-23T23:58:12.562 INFO:tasks.workunit.client.0.smithi031.stderr:+ ceph_test_client 2024-03-23T23:58:12.606 INFO:tasks.workunit.client.0.smithi031.stdout:[==========] Running 25 tests from 1 test suite. 2024-03-23T23:58:12.606 INFO:tasks.workunit.client.0.smithi031.stdout:[----------] Global test environment set-up. 2024-03-23T23:58:12.606 INFO:tasks.workunit.client.0.smithi031.stdout:[----------] 25 tests from TestClient 2024-03-23T23:58:12.606 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.SingleTargetMdsCommand 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.606+0000 7f010c985480 1 -- start start 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a12f9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a12f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a13a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1277160 con 0x5611a1247460 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a11effe0 con 0x5611a1308d30 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127b2d0 con 0x5611a1279010 2024-03-23T23:58:12.617 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.607+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a12f9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a12f9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53196/0 (socket says 172.21.15.31:53196) 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 -- 172.21.15.31:0/21884285 learned_addr learned my addr 172.21.15.31:0/21884285 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0103e00640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a12f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f010a600640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a13a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 -- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 msgr2=0x5611a12f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a12f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 -- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 msgr2=0x5611a13a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a13a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a118bdb0 con 0x5611a1247460 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0109c00640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a12f9280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00b9a0 tx=0x7f00fc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf231e12d89e390 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.608+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc014030 con 0x5611a1247460 2024-03-23T23:58:12.618 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00fc009a60 con 0x5611a1247460 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 10 client.4659 Subscribing to map 'mdsmap' 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a13a4f50 con 0x5611a1247460 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f00faa00640 20 client.4659 tick 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f00faa00640 20 client.4659 collect_and_send_metrics 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f00faa00640 20 client.4659 collect_and_send_global_metrics 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f00faa00640 5 client.4659 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f00faa00640 20 client.4659 trim_cache size 0 max 16384 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f00faa00640 20 client.4659 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc006070 con 0x5611a1247460 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc00a040 con 0x5611a1247460 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f0103400640 1 client.4659 handle_mds_map epoch 8 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 20 client.4659 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:12.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 10 client.4659 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 20 client.4659 mds is 0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 10 client.4659 _open_mds_session mds.0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a13a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a12327b0 con 0x5611a13a59d0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.609+0000 7f010c985480 10 client.4659 waiting for session to mds.0 to open 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.610+0000 7f0103e00640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a13a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.611+0000 7f0103e00640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a13a7dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5da422960f26281 server_cookie=66f603cfa711fa56 in_seq=0 out_seq=0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.611+0000 7f0103400640 10 client.4659 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a12327b0 con 0x5611a13a59d0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f0103400640 10 client.4659 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f0103400640 10 client.4659 renew_caps mds.0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0009510 con 0x5611a13a59d0 2024-03-23T23:58:12.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f0103400640 10 client.4659 connect_mds_targets for mds.0 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 10 client.4659 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 20 client.4659 mds is 0 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 10 client.4659 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 20 client.4659 encode_cap_releases enter (req: 0x5611a13a55c0, mds: 0) 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 20 client.4659 send_request set sent_stamp to 2024-03-23T23:58:12.617960+0000 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 10 client.4659 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.610622+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.610622+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a8900 con 0x5611a13a59d0 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.616+0000 7f010c985480 20 client.4659 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.617+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0009510 con 0x5611a13a59d0 2024-03-23T23:58:12.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.617+0000 7f0103400640 10 client.4659 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:12.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f4052440 con 0x5611a13a59d0 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 insert_trace from 2024-03-23T23:58:12.617960+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 features 0xffffffffffffffff 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 update_snap_trace len 70 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 get_snap_realm 0x1 0x7f00f0009730, nref now is 1 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 15 client.4659 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 15 client.4659 snapc 1=[] 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 put_snap_realm 0x1 0x7f00f0009730 2 -> 1 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 hrm is_target=1 is_dentry=0 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0009820) - ctime 2024-03-23T23:56:30.869655+0000 mtime 2024-03-23T23:56:30.869655+0000 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 dir hash is 2 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 12 client.4659 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 12 client.4659 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=- has_dir_layout 0x7f00f0009820) caps pAsLsXsFs 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 get_snap_realm 0x1 0x7f00f0009730, nref was 1 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 get_snap_realm 0x1 0x7f00f0009730, nref now is 2 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 15 client.4659 add_update_cap first one, opened snaprealm 0x7f00f0009730 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0009820) 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 add_update_cap calling signal_caps_inode 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 10 client.4659 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0009820) 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 put_snap_realm 0x1 0x7f00f0009730 2 -> 1 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:12.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 20 client.4659 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 20 client.4659 lat 0.001215 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 20 client.4659 _ll_get 0x7f00f0009820 0x1 -> 1 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00f404ae50 con 0x5611a1247460 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mon.0 v2:172.21.15.31:3300/0 5 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00fc01e070 con 0x5611a1247460 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 10 client.4659 fetch_fsmap learned FSMap version 8 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({fsmap=8}) v3 -- 0x5611a13a8ca0 con 0x5611a1247460 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mon.0 v2:172.21.15.31:3300/0 6 ==== fsmap(e 8) v1 ==== 2164+0+0 (secure 0 0 0) 0x7f00fc009ca0 con 0x5611a1247460 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 10 client.4659 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-23T23:58:12.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a13abd20 0x5611a13ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 4 client.4659 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "session ls", "format": "json"}] 2024-03-23T23:58:12.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.618+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] -- command(tid 0: {"prefix": "session ls", "format": "json"}) v1 -- 0x5611a1201480 con 0x5611a13abd20 2024-03-23T23:58:12.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.619+0000 7f010a600640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a13abd20 0x5611a13ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.619+0000 7f010a600640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a13abd20 0x5611a13ae110 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=ea27a24af7850d00 server_cookie=287b691bda762145 in_seq=0 out_seq=0 2024-03-23T23:58:12.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.619+0000 7f0103400640 10 client.4659 ms_handle_connect on v2:172.21.15.31:6832/481677666 2024-03-23T23:58:12.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mds.? v2:172.21.15.31:6832/481677666 1 ==== command_reply(tid 0: -38 ) v1 ==== 8+0+0 (crc 0 0 0) 0x5611a1201480 con 0x5611a13abd20 2024-03-23T23:58:12.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f0103400640 10 client.4659 handle_command_reply: tid=0 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 2 client.4659 unmount 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 2 client.4659 unmounting 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 _ll_drop_pins 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 _ll_put 0x7f00f0009820 0x1 1 -> 0 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 nothing to flush 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 1 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 flush_caps_sync 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 trim_cache size 0 max 16384 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) n = 8 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0009820) 2024-03-23T23:58:12.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 15 client.4659 remove_cap last one, closing snaprealm 0x7f00f0009730 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 20 client.4659 put_snap_realm 0x1 0x7f00f0009730 1 -> 0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 10 client.4659 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f00f0009820) 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 2 client.4659 _close_mds_session mds.0 seq 0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a13ae650 con 0x5611a13a59d0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.620+0000 7f010c985480 2 client.4659 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a13ae650 con 0x5611a13a59d0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 10 client.4659 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 5 client.4659 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 1 -- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 msgr2=0x5611a13a7dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a13a7dc0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 10 client.4659 remove_session_caps mds.0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 10 client.4659 kick_requests_closed for mds.0 2024-03-23T23:58:12.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 10 client.4659 unmounting: trim pass, size was 0+0 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 20 client.4659 trim_cache size 0 max 16384 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 10 client.4659 unmounting: trim pass, size still 0+0 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 2 client.4659 unmounted. 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 client.4659 shutdown 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 msgr2=0x5611a12f9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a12f9280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00b9a0 tx=0x7f00fc00be60 comp rx=0 tx=0).stop 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 shutdown_connections 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a13abd20 0x5611a13ae110 crc :-1 s=READY pgs=5 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a13a7dc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a13a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a12f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010a600640 1 -- 172.21.15.31:0/21884285 reap_dead start 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 --2- 172.21.15.31:0/21884285 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a12f9280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f0103400640 0 client.4659 ms_handle_reset on v2:172.21.15.31:6832/481677666 2024-03-23T23:58:12.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 >> 172.21.15.31:0/21884285 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:12.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 shutdown_connections 2024-03-23T23:58:12.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 1 -- 172.21.15.31:0/21884285 wait complete. 2024-03-23T23:58:12.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.624+0000 7f010c985480 20 client.4659 trim_cache size 0 max 16384 2024-03-23T23:58:12.633 INFO:tasks.workunit.client.0.smithi031.stdout:SingleTargetMdsCommand: [ OK ] TestClient.SingleTargetMdsCommand (19 ms) 2024-03-23T23:58:12.633 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.MultiTargetMdsCommand 2024-03-23T23:58:12.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.625+0000 7f010c985480 1 -- start start 2024-03-23T23:58:12.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:12.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a1276360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a1301ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a1312df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0007e60 con 0x5611a1247460 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000a7a0 con 0x5611a1308d30 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0008eb0 con 0x5611a1279010 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a1276360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a1276360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53212/0 (socket says 172.21.15.31:53212) 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.626+0000 7f0109c00640 1 -- 172.21.15.31:0/993914727 learned_addr learned my addr 172.21.15.31:0/993914727 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:12.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0103e00640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a1301ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f010a600640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a1312df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0109c00640 1 -- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 msgr2=0x5611a1301ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0109c00640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a1301ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0109c00640 1 -- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 msgr2=0x5611a1312df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0109c00640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a1312df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0109c00640 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1278db0 con 0x5611a1247460 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f010a600640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a1312df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0103e00640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a1301ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0109c00640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a1276360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000ea0 tx=0x7f00fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7259e30a8d2bbe13 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.627+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc014030 con 0x5611a1247460 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00fc009a60 con 0x5611a1247460 2024-03-23T23:58:12.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 10 client.4662 Subscribing to map 'mdsmap' 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a127a1e0 con 0x5611a1247460 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f00fb400640 20 client.4662 tick 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f00fb400640 20 client.4662 collect_and_send_metrics 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f00fb400640 20 client.4662 collect_and_send_global_metrics 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f00fb400640 5 client.4662 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f00fb400640 20 client.4662 trim_cache size 0 max 16384 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f00fb400640 20 client.4662 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc015040 con 0x5611a1247460 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc009c80 con 0x5611a1247460 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f0102000640 1 client.4662 handle_mds_map epoch 8 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 20 client.4662 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 10 client.4662 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 20 client.4662 mds is 0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 10 client.4662 _open_mds_session mds.0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a1245cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1246da0 con 0x5611a13a59d0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.628+0000 7f010c985480 10 client.4662 waiting for session to mds.0 to open 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.629+0000 7f0103e00640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a1245cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.629+0000 7f0103e00640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a1245cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8c8eb8d9acb905 server_cookie=1a0496a1de68cd2b in_seq=0 out_seq=0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.629+0000 7f0102000640 10 client.4662 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1246da0 con 0x5611a13a59d0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f0102000640 10 client.4662 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f0102000640 10 client.4662 renew_caps mds.0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f000af20 con 0x5611a13a59d0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f0102000640 10 client.4662 connect_mds_targets for mds.0 2024-03-23T23:58:12.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 10 client.4662 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 20 client.4662 mds is 0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 10 client.4662 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 20 client.4662 encode_cap_releases enter (req: 0x5611a139de80, mds: 0) 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 20 client.4662 send_request set sent_stamp to 2024-03-23T23:58:12.634863+0000 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 10 client.4662 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.629457+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.629457+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12463a0 con 0x5611a13a59d0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.633+0000 7f010c985480 20 client.4662 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f000af20 con 0x5611a13a59d0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f4052440 con 0x5611a13a59d0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 insert_trace from 2024-03-23T23:58:12.634863+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:12.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 features 0xffffffffffffffff 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 update_snap_trace len 70 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 get_snap_realm 0x1 0x7f00f000b140, nref now is 1 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 15 client.4662 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 15 client.4662 snapc 1=[] 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 put_snap_realm 0x1 0x7f00f000b140 2 -> 1 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 hrm is_target=1 is_dentry=0 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f000b230) - ctime 2024-03-23T23:56:30.869655+0000 mtime 2024-03-23T23:56:30.869655+0000 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 dir hash is 2 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 12 client.4662 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:12.644 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 12 client.4662 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=- has_dir_layout 0x7f00f000b230) caps pAsLsXsFs 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 get_snap_realm 0x1 0x7f00f000b140, nref was 1 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 get_snap_realm 0x1 0x7f00f000b140, nref now is 2 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 15 client.4662 add_update_cap first one, opened snaprealm 0x7f00f000b140 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000b230) 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 add_update_cap calling signal_caps_inode 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 10 client.4662 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000b230) 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 put_snap_realm 0x1 0x7f00f000b140 2 -> 1 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f010c985480 20 client.4662 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f010c985480 20 client.4662 lat 0.000734 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f010c985480 20 client.4662 _ll_get 0x7f00f000b230 0x1 -> 1 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.645 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611a1174b70 con 0x5611a1247460 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mon.0 v2:172.21.15.31:3300/0 5 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00fc034080 con 0x5611a1247460 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f010c985480 10 client.4662 fetch_fsmap learned FSMap version 8 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.634+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({fsmap=8}) v3 -- 0x5611a13a36e0 con 0x5611a1247460 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mon.0 v2:172.21.15.31:3300/0 6 ==== fsmap(e 8) v1 ==== 2164+0+0 (secure 0 0 0) 0x7f00fc023550 con 0x5611a1247460 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 10 client.4662 resolve_mds: resolving `*' to all MDS daemons 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 10 client.4662 resolve_mds: appending daemon mds.a to targets 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 10 client.4662 resolve_mds: appending daemon mds.b to targets 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a12f6210 0x5611a12f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 4 client.4662 mds_command: new command op to 4266 tid=0 multi_id=1 [{"prefix": "session ls", "format": "json"}] 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] -- command(tid 0: {"prefix": "session ls", "format": "json"}) v1 -- 0x5611a11c5700 con 0x5611a12f6210 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 4 client.4662 mds_command: new command op to 4272 tid=1 multi_id=1 [{"prefix": "session ls", "format": "json"}] 2024-03-23T23:58:12.646 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- command(tid 1: {"prefix": "session ls", "format": "json"}) v1 -- 0x5611a12f6b70 con 0x5611a13a59d0 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.635+0000 7f010a600640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a12f6210 0x5611a12f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010a600640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a12f6210 0x5611a12f6630 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.? client_cookie=51fe6d64e5882c4 server_cookie=cd489177796f61b in_seq=0 out_seq=0 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f0102000640 10 client.4662 ms_handle_connect on v2:172.21.15.31:6832/481677666 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+1170 (crc 0 0 0) 0x5611a12f6b70 con 0x5611a13a59d0 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f0102000640 10 client.4662 handle_command_reply: tid=1 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mds.? v2:172.21.15.31:6832/481677666 1 ==== command_reply(tid 0: -38 ) v1 ==== 8+0+0 (crc 0 0 0) 0x5611a11c5700 con 0x5611a12f6210 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f0102000640 10 client.4662 handle_command_reply: tid=0 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 2 client.4662 unmount 2024-03-23T23:58:12.647 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 2 client.4662 unmounting 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 _ll_drop_pins 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 _ll_put 0x7f00f000b230 0x1 1 -> 0 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 nothing to flush 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 1 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 flush_caps_sync 2024-03-23T23:58:12.648 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 trim_cache size 0 max 16384 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) n = 8 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000b230) 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 15 client.4662 remove_cap last one, closing snaprealm 0x7f00f000b140 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 20 client.4662 put_snap_realm 0x1 0x7f00f000b140 1 -> 0 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 10 client.4662 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f00f000b230) 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 2 client.4662 _close_mds_session mds.0 seq 0 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a1232570 con 0x5611a13a59d0 2024-03-23T23:58:12.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.636+0000 7f010c985480 2 client.4662 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1232570 con 0x5611a13a59d0 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 10 client.4662 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 5 client.4662 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 1 -- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 msgr2=0x5611a1245cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a1245cb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 10 client.4662 remove_session_caps mds.0 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 10 client.4662 kick_requests_closed for mds.0 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 10 client.4662 unmounting: trim pass, size was 0+0 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 20 client.4662 trim_cache size 0 max 16384 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 10 client.4662 unmounting: trim pass, size still 0+0 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 2 client.4662 unmounted. 2024-03-23T23:58:12.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 client.4662 shutdown 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 msgr2=0x5611a1276360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a1276360 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000ea0 tx=0x7f00fc000ed0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 shutdown_connections 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:6832/481677666,v1:172.21.15.31:6833/481677666] conn(0x5611a12f6210 0x5611a12f6630 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a1245cb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a1312df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a1301ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 --2- 172.21.15.31:0/993914727 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247460 0x5611a1276360 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010a600640 1 -- 172.21.15.31:0/993914727 reap_dead start 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 >> 172.21.15.31:0/993914727 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f0102000640 0 client.4662 ms_handle_reset on v2:172.21.15.31:6832/481677666 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.640+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 shutdown_connections 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.641+0000 7f010c985480 1 -- 172.21.15.31:0/993914727 wait complete. 2024-03-23T23:58:12.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.641+0000 7f010c985480 20 client.4662 trim_cache size 0 max 16384 2024-03-23T23:58:12.653 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.MultiTargetMdsCommand (16 ms) 2024-03-23T23:58:12.653 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritev 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.641+0000 7f010c985480 1 -- start start 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1279010 0x5611a13a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1308d30 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13a59d0 0x5611a13a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0004190 con 0x5611a1308d30 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000c250 con 0x5611a1279010 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000a920 con 0x5611a13a59d0 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1308d30 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.642+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1308d30 0x5611a13a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53228/0 (socket says 172.21.15.31:53228) 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103e00640 1 -- 172.21.15.31:0/2186165943 learned_addr learned my addr 172.21.15.31:0/2186165943 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f010a600640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13a59d0 0x5611a13a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0109c00640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1279010 0x5611a13a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103e00640 1 -- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13a59d0 msgr2=0x5611a13a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103e00640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13a59d0 0x5611a13a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103e00640 1 -- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1279010 msgr2=0x5611a13a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103e00640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1279010 0x5611a13a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103e00640 1 -- 172.21.15.31:0/2186165943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a32f0 con 0x5611a1308d30 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103e00640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1308d30 0x5611a13a7dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f00f401ce40 tx=0x7f00f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca3324e49ed2268 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.643+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4057040 con 0x5611a1308d30 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00f404ac50 con 0x5611a1308d30 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 10 client.4665 Subscribing to map 'mdsmap' 2024-03-23T23:58:12.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a13a52a0 con 0x5611a1308d30 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f00faa00640 20 client.4665 tick 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f00faa00640 20 client.4665 collect_and_send_metrics 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f00faa00640 20 client.4665 collect_and_send_global_metrics 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f00faa00640 5 client.4665 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f00faa00640 20 client.4665 trim_cache size 0 max 16384 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f00faa00640 20 client.4665 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f40662e0 con 0x5611a1308d30 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00f4015000 con 0x5611a1308d30 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f0103400640 1 client.4665 handle_mds_map epoch 8 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 20 client.4665 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 10 client.4665 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 20 client.4665 mds is 0 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 10 client.4665 _open_mds_session mds.0 2024-03-23T23:58:12.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13131b0 0x5611a13019f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1301f30 con 0x5611a13131b0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.644+0000 7f010c985480 10 client.4665 waiting for session to mds.0 to open 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.645+0000 7f0109c00640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13131b0 0x5611a13019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.646+0000 7f0109c00640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13131b0 0x5611a13019f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d770b335f24bdd16 server_cookie=94eb24655f9ada23 in_seq=0 out_seq=0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.646+0000 7f0103400640 10 client.4665 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1301f30 con 0x5611a13131b0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f0103400640 10 client.4665 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f0103400640 10 client.4665 renew_caps mds.0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0007330 con 0x5611a13131b0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f0103400640 10 client.4665 connect_mds_targets for mds.0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 10 client.4665 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 20 client.4665 mds is 0 2024-03-23T23:58:12.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 10 client.4665 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 20 client.4665 encode_cap_releases enter (req: 0x5611a1312df0, mds: 0) 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 20 client.4665 send_request set sent_stamp to 2024-03-23T23:58:12.650966+0000 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 10 client.4665 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.645590+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.645590+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f4eb0 con 0x5611a13131b0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.649+0000 7f010c985480 20 client.4665 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0007330 con 0x5611a13131b0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc0010e0 con 0x5611a13131b0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 insert_trace from 2024-03-23T23:58:12.650966+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 features 0xffffffffffffffff 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 update_snap_trace len 70 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:12.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 get_snap_realm 0x1 0x7f00f000c3d0, nref now is 1 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 15 client.4665 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 15 client.4665 snapc 1=[] 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 put_snap_realm 0x1 0x7f00f000c3d0 2 -> 1 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 hrm is_target=1 is_dentry=0 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f000c4c0) - ctime 2024-03-23T23:56:30.869655+0000 mtime 2024-03-23T23:56:30.869655+0000 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 dir hash is 2 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 12 client.4665 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 12 client.4665 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=- has_dir_layout 0x7f00f000c4c0) caps pAsLsXsFs 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 get_snap_realm 0x1 0x7f00f000c3d0, nref was 1 2024-03-23T23:58:12.664 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 get_snap_realm 0x1 0x7f00f000c3d0, nref now is 2 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 15 client.4665 add_update_cap first one, opened snaprealm 0x7f00f000c3d0 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000c4c0) 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 add_update_cap calling signal_caps_inode 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000c4c0) 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 put_snap_realm 0x1 0x7f00f000c3d0 2 -> 1 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 lat 0.000796 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 _ll_get 0x7f00f000c4c0 0x1 -> 1 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 2 client.4665 unmount 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 unmounting: trim pass, size was 0+1 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 20 client.4665 trim_cache size 0 max 16384 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f0103400640 10 client.4665 unmounting: trim pass, size still 0+1 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 2 client.4665 unmounting 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 _ll_drop_pins 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 _ll_put 0x7f00f000c4c0 0x1 1 -> 0 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) 2024-03-23T23:58:12.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 nothing to flush 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 1 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 flush_caps_sync 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 trim_cache size 0 max 16384 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) n = 8 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000c4c0) 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 15 client.4665 remove_cap last one, closing snaprealm 0x7f00f000c3d0 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 20 client.4665 put_snap_realm 0x1 0x7f00f000c3d0 1 -> 0 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 10 client.4665 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=- COMPLETE has_dir_layout 0x7f00f000c4c0) 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 2 client.4665 _close_mds_session mds.0 seq 0 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a12f5390 con 0x5611a13131b0 2024-03-23T23:58:12.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.650+0000 7f010c985480 2 client.4665 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12f5390 con 0x5611a13131b0 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 10 client.4665 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 5 client.4665 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 1 -- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13131b0 msgr2=0x5611a13019f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13131b0 0x5611a13019f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 10 client.4665 remove_session_caps mds.0 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 10 client.4665 kick_requests_closed for mds.0 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 10 client.4665 unmounting: trim pass, size was 0+0 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 20 client.4665 trim_cache size 0 max 16384 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f0103400640 10 client.4665 unmounting: trim pass, size still 0+0 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 2 client.4665 unmounted. 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 client.4665 shutdown 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1308d30 msgr2=0x5611a13a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1308d30 0x5611a13a7dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f00f401ce40 tx=0x7f00f4002fb0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 shutdown_connections 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13131b0 0x5611a13019f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13a59d0 0x5611a13a2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1308d30 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 --2- 172.21.15.31:0/2186165943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1279010 0x5611a13a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 >> 172.21.15.31:0/2186165943 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 shutdown_connections 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.655+0000 7f010c985480 1 -- 172.21.15.31:0/2186165943 wait complete. 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.656+0000 7f010c985480 20 client.4665 trim_cache size 0 max 16384 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.656+0000 7f010c985480 1 -- start start 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a13a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a13a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13131b0 0x5611a13019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.669 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000b790 con 0x5611a13131b0 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a8ff0 con 0x5611a1308d30 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a9470 con 0x5611a1279010 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.657+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13131b0 0x5611a13019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13131b0 0x5611a13019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53236/0 (socket says 172.21.15.31:53236) 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 -- 172.21.15.31:0/2960044418 learned_addr learned my addr 172.21.15.31:0/2960044418 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f0109c00640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a13a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f0103e00640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a13a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 -- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 msgr2=0x5611a13a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1279010 0x5611a13a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.670 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 -- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 msgr2=0x5611a13a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.671 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1308d30 0x5611a13a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.671 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1245f70 con 0x5611a13131b0 2024-03-23T23:58:12.671 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f010a600640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13131b0 0x5611a13019d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0104003370 tx=0x7f010400d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba541516e32ea40 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.671 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.658+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:12.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104029060 con 0x5611a13131b0 2024-03-23T23:58:12.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f010c985480 10 client.4668 Subscribing to map 'mdsmap' 2024-03-23T23:58:12.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a127dd70 con 0x5611a13131b0 2024-03-23T23:58:12.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104017650 con 0x5611a13131b0 2024-03-23T23:58:12.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f00fb400640 20 client.4668 tick 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f00fb400640 20 client.4668 collect_and_send_metrics 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f00fb400640 20 client.4668 collect_and_send_global_metrics 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f00fb400640 5 client.4668 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f00fb400640 20 client.4668 trim_cache size 0 max 16384 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f00fb400640 20 client.4668 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104017850 con 0x5611a13131b0 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.659+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f070 con 0x5611a13131b0 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f0102000640 1 client.4668 handle_mds_map epoch 8 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f010c985480 20 client.4668 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f010c985480 10 client.4668 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f010c985480 20 client.4668 mds is 0 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f010c985480 10 client.4668 _open_mds_session mds.0 2024-03-23T23:58:12.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f010c985480 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a12f5ff0 con 0x5611a13a59d0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f010c985480 10 client.4668 waiting for session to mds.0 to open 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.660+0000 7f0109c00640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.661+0000 7f0109c00640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a12758a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a46cbe2bacc1f0ec server_cookie=f5d75964430526b in_seq=0 out_seq=0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.661+0000 7f0102000640 10 client.4668 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a12f5ff0 con 0x5611a13a59d0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f0102000640 10 client.4668 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f0102000640 10 client.4668 renew_caps mds.0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f000c740 con 0x5611a13a59d0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f0102000640 10 client.4668 connect_mds_targets for mds.0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 10 client.4668 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 20 client.4668 mds is 0 2024-03-23T23:58:12.677 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 10 client.4668 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 20 client.4668 encode_cap_releases enter (req: 0x5611a13a80f0, mds: 0) 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 20 client.4668 send_request set sent_stamp to 2024-03-23T23:58:12.667188+0000 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 10 client.4668 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.661055+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.661055+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1275de0 con 0x5611a13a59d0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f010c985480 20 client.4668 awaiting reply|forward|kick on 0x7ffef7334510 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f000c740 con 0x5611a13a59d0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.666+0000 7f0102000640 10 client.4668 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc03d040 con 0x5611a13a59d0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 insert_trace from 2024-03-23T23:58:12.667188+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 features 0xffffffffffffffff 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 update_snap_trace len 70 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:12.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref now is 1 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 15 client.4668 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 15 client.4668 snapc 1=[] 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 put_snap_realm 0x1 0x7f00f000c960 2 -> 1 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 hrm is_target=1 is_dentry=0 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f000ca50) - ctime 2024-03-23T23:56:30.869655+0000 mtime 2024-03-23T23:56:30.869655+0000 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 dir hash is 2 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 12 client.4668 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 12 client.4668 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=- has_dir_layout 0x7f00f000ca50) caps pAsLsXsFs 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref was 1 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref now is 2 2024-03-23T23:58:12.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 15 client.4668 add_update_cap first one, opened snaprealm 0x7f00f000c960 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 add_update_cap calling signal_caps_inode 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 10 client.4668 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 put_snap_realm 0x1 0x7f00f000c960 2 -> 1 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 handle_client_reply signalling caller 0x7ffef7334510 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 lat 0.000950 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 _ll_get 0x7f00f000ca50 0x1 -> 1 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f0102000640 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 8 client.4668 _ll_create 0x1.head test_llreadvllwritevfile44572 0666 578, uid 0, gid 0 2024-03-23T23:58:12.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 10 client.4668 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) dn 'test_llreadvllwritevfile44572' 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 10 client.4668 _getattr mask As issued=1 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 3 client.4668 may_create 0x7f00f000ca50 = 0 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 8 client.4668 _create(0x1 test_llreadvllwritevfile44572, 0666) 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) name test_llreadvllwritevfile44572 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 15 open_dir 0x5611a13a8710 on 0x7f00f000ca50 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 15 client.4668 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) 'test_llreadvllwritevfile44572' dn 0x1.head["test_llreadvllwritevfile44572"] (new dn) 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 choose_target_mds inode dir hash is 2 on test_llreadvllwritevfile44572 => 568492468 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) is_hash=1 hash=568492468 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 10 client.4668 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 mds is 0 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 10 client.4668 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:12.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 encode_cap_releases enter (req: 0x5611a1276130, mds: 0) 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 encode_dentry_release enter(dn:0x7f00f0009730) 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f000ca50), req:0x5611a1276130 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 send_request set sent_stamp to 2024-03-23T23:58:12.668244+0000 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 10 client.4668 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevfile44572 2024-03-23T23:58:12.668219+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevfile44572 2024-03-23T23:58:12.668219+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f65f0 con 0x5611a13a59d0 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.667+0000 7f010c985480 20 client.4668 awaiting reply|forward|kick on 0x7ffef7334350 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 850+0+0 (crc 0 0 0) 0x7f00fc023430 con 0x5611a13a59d0 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 insert_trace from 2024-03-23T23:58:12.668244+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 features 0xffffffffffffffff 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 update_snap_trace len 70 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref was 1 2024-03-23T23:58:12.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref now is 2 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 hrm is_target=1 is_dentry=1 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) - ctime 2024-03-23T23:58:12.668219+0000 mtime 2024-03-23T23:58:12.668219+0000 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 12 client.4668 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 12 client.4668 add_update_inode adding 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref was 2 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref now is 3 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 15 client.4668 add_update_cap first one, opened snaprealm 0x7f00f000c960 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 add_update_cap calling signal_caps_inode 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 12 client.4668 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f000ca50) caps pAsLsXsFs 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:56:30.869655+0000 ctime=2024-03-23T23:56:30.869655+0000 change_attr=0 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f000ca50) pAsLsXs ctime 2024-03-23T23:58:12.668219+0000 mtime 2024-03-23T23:58:12.668219+0000 2024-03-23T23:58:12.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 dir hash is 2 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 12 client.4668 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 1 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 clearing (I_COMPLETE|I_DIR_ORDERED) on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 10 client.4668 add_update_cap calling signal_caps_inode 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 12 client.4668 insert_dentry_inode 'test_llreadvllwritevfile44572' vino 0x10000000000.head in dir 0x1.head dn 0x7f00f0009730 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 15 client.4668 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) 'test_llreadvllwritevfile44572' to inode 0x7f00f0015840 dn 0x1.head["test_llreadvllwritevfile44572"] (old dn) 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 link inode 0x7f00f0015840 parents now 0x1.head["test_llreadvllwritevfile44572"] 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 15 client.4668 update_dentry_lease 0x1.head["test_llreadvllwritevfile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:12.668244+0000 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 put_snap_realm 0x1 0x7f00f000c960 3 -> 2 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 handle_client_reply signalling caller 0x7ffef7334350 2024-03-23T23:58:12.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 client.4668 delegated_inos: [] 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 client.4668 make_request created ino 0x10000000000 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 make_request target is 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 lat 0.007090 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000000.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 client.4668 _create_fh 0x10000000000 mode 3 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 trim_cache size 1 max 16384 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 8 client.4668 create(#0x1/test_llreadvllwritevfile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 _ll_create created = 1 2024-03-23T23:58:12.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 8 client.4668 _ll_create 0x1.head test_llreadvllwritevfile44572 0666 578 = 0 (0x5611a1182140 10000000000) 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 _ll_get 0x7f00f0015840 0x10000000000 -> 1 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 client.4668 fill_statx on 0x10000000000 snap/devhead mode 0100666 mtime 2024-03-23T23:58:12.668219+0000 ctime 2024-03-23T23:58:12.668219+0000 change_attr 0 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 client.4668 get_quota_root realm 0x1 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 client.4668 get_quota_root 0x10000000000.head -> 0x1.head 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 10 client.4668 cur file size is 0 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a124a280 0x5611a124c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- osd_op(unknown.0.0:1 3.30 3:0cf6ad0f:::10000000000.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x7f00f000b9f0 con 0x5611a124a280 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- osd_op(unknown.0.0:2 3.30 3:0cf6ad0f:::10000000000.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x7f00f0009f40 con 0x5611a124a280 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.674+0000 7f0102000640 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.675+0000 7f0103e00640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a124a280 0x5611a124c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.676+0000 7f0103e00640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a124a280 0x5611a124c710 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=a060bd595cddf86c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.676+0000 7f0102000640 10 client.4668 ms_handle_connect on v2:172.21.15.59:6800/814178259 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.677+0000 7f0103e00640 1 -- 172.21.15.31:0/2960044418 <== osd.5 v2:172.21.15.59:6800/814178259 1 ==== osd_op_reply(1 10000000000.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a124a280 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f0103e00640 1 -- 172.21.15.31:0/2960044418 <== osd.5 v2:172.21.15.59:6800/814178259 2 ==== osd_op_reply(2 10000000000.00000000 [create] v23'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a124a280 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c985480 10 client.4668 wanted_max_size 0 -> 14 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c985480 10 client.4668 get_caps 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c985480 20 client.4668 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c985480 10 client.4668 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c985480 5 client.4668 get_cap_ref got first FILE_BUFFER ref on 0x10000000000.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c985480 5 client.4668 get_cap_ref got first FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={4=0,1024=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c985480 3 client.4668 pwritev(0x5611a1182140, "...", 14, 0) = 0 2024-03-23T23:58:12.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.679+0000 7f010c600640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) - -> Fw 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 get_quota_root realm 0x1 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 get_quota_root 0x10000000000.head -> 0x1.head 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 7 client.4668 wrote to 14, extending file size 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) Fw -> Fw 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 19 client.4668 C_Write_Finisher::try_complete this 0x5611a11914d0 onuninlinefinished 1 iofinished 1 iofinished_r 14 fsync_finished 1 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 19 client.4668 complete with iofinished_r 14 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 _read_async 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 0~14 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 3 client.4668 preadv(0x5611a1182140, 0) = 0 2024-03-23T23:58:12.693 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_quota_root realm 0x1 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_quota_root 0x10000000000.head -> 0x1.head 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 cur file size is 14 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 wanted_max_size 14 -> 126 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 20 client.4668 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 3 client.4668 pwritev(0x5611a1182140, "...", 26, 100) = 0 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) Fw -> Fw 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681078+0000 ctime=2024-03-23T23:58:12.681078+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 get_quota_root realm 0x1 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 get_quota_root 0x10000000000.head -> 0x1.head 2024-03-23T23:58:12.694 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 7 client.4668 wrote to 126, extending file size 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) Fw -> Fw 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 19 client.4668 C_Write_Finisher::try_complete this 0x5611a118ec70 onuninlinefinished 1 iofinished 1 iofinished_r 26 fsync_finished 1 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 19 client.4668 complete with iofinished_r 26 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 _read_async 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 100~26 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 3 client.4668 preadv(0x5611a1182140, 100) = 0 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_quota_root realm 0x1 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_quota_root 0x10000000000.head -> 0x1.head 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 cur file size is 126 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 wanted_max_size 126 -> 1031 2024-03-23T23:58:12.695 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 get_caps 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 20 client.4668 clear_suid_sgid 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=126/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 40] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 10 client.4668 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c985480 3 client.4668 pwritev(0x5611a1182140, "...", 31, 1000) = 0 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) Fw -> Fw 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681272+0000 ctime=2024-03-23T23:58:12.681272+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 get_quota_root realm 0x1 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 get_quota_root 0x10000000000.head -> 0x1.head 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 7 client.4668 wrote to 1031, extending file size 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 mark_caps_dirty 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) Fw -> Fw 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 19 client.4668 C_Write_Finisher::try_complete this 0x5611a11c0170 onuninlinefinished 1 iofinished 1 iofinished_r 31 fsync_finished 0 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 19 client.4668 kickoff fsync onfinish 0x5611a13a8470 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 15 client.4668 Client::C_nonblocking_fsync_state::advance progress 0 flush_wait 0 flush_completed 0 result 0 waitfor_safe 0 onfinish 0x5611a1276680 2024-03-23T23:58:12.696 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 15 client.4668 Client::C_nonblocking_fsync_state::advance - case 0 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 _flush 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- osd_op(unknown.0.0:3 3.30 3:0cf6ad0f:::10000000000.00000000:head [write 0~14 in=14b,write 100~26 in=26b,write 1000~31 in=31b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x7f00d8002840 con 0x5611a124a280 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 15 client.4668 using return-valued form of _fsync 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 check_caps on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) wanted pAsxXsxFsxcrwb used Fcwb issued pAsxLsXsxFsxcrwb revoking - flags=3 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 mark_caps_flushing Fw 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 mark_caps_clean 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 10 client.4668 send_cap 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 71] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) mds.0 seq 1 used Fcwb want pAsxXsxFsxcrwb flush Fw retain pAsxLsxXsxFsxcrwbl held pAsxLsXsxFsxcrwb revoking - dropping - 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 15 client.4668 auth cap, requesting max_size 1031 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000000 1 seq 1 tid 2 caps=pAsxLsXsxFsxcrwb dirty=Fw wanted=pAsxXsxFsxcrwb follows 1 size 1031/1031 ts 1/18446744073709551615 mtime 2024-03-23T23:58:12.681460+0000 ctime 2024-03-23T23:58:12.681460+0000 change_attr 3) v12 -- 0x7f00d8002f90 con 0x5611a13a59d0 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 15 client.4668 Client::C_nonblocking_fsync_state::advance - case 1 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.680+0000 7f010c600640 15 client.4668 waiting on data to flush 2024-03-23T23:58:12.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0103e00640 1 -- 172.21.15.31:0/2960044418 <== osd.5 v2:172.21.15.59:6800/814178259 3 ==== osd_op_reply(3 10000000000.00000000 [write 0~14,write 100~26,write 1000~31] v23'2 uv2 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a124a280 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 10 client.4668 _flushed 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=1,8192=1} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 5 client.4668 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 5 client.4668 put_cap_ref dropped last FILE_CACHE ref on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 2 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 complete_flush r 0 progress 2 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 Client::C_nonblocking_fsync_state::advance progress 2 flush_wait 1 flush_completed 1 result 0 waitfor_safe 0 onfinish 0x5611a1276680 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 Client::C_nonblocking_fsync_state::advance - case 2 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 got 0 from flush writeback 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 Client::C_nonblocking_fsync_state::advance - case 3 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 in->flushing_cap_tids.empty() 0 in->flushing_caps 4096 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 Client::C_nonblocking_fsync_state::advance - flushing_caps 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 15 client.4668 Client::C_nonblocking_fsync_state::advance it->first 2 flush_tid 2 2024-03-23T23:58:12.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 10 client.4668 advance on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) flushing Fw flush_tid 2 last 2 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.684+0000 7f0100c00640 10 client.4668 Adding onfinish 0x5611a1276680 for C_nonblocking_fsync_state 0x7f00d8001d60 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_caps(flush_ack ino 0x10000000000 1 seq 1 tid 2 caps=pAsxLsXsxFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d8002f90 con 0x5611a13a59d0 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 5 client.4668 set_cap_epoch_barrier epoch = 21 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 10 client.4668 mds.0 seq now 1 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 5 client.4668 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) with Fw 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 5 client.4668 flushing_caps Fw -> - 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 10 client.4668 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=1,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) !flushing 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 10 client.4668 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 15 client.4668 C_nonblocking_fsync_state_advancer::finish r 0 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 15 client.4668 Client::C_nonblocking_fsync_state::advance progress 4 flush_wait 1 flush_completed 1 result 0 waitfor_safe 0 onfinish 0x5611a1276680 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 15 client.4668 Client::C_nonblocking_fsync_state::advance - case 4 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 15 client.4668 in->flushing_cap_tids.empty() 1 in->flushing_caps 0 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 10 client.4668 ino 0x10000000000 has no uncommitted writes 2024-03-23T23:58:12.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 3 client.4668 finish_fsync r = 0 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 19 client.4668 C_Write_Finisher::try_complete this 0x5611a11c0170 onuninlinefinished 1 iofinished 1 iofinished_r 31 fsync_finished 1 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 19 client.4668 complete with iofinished_r 31 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 get_caps 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 _read_async 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=1,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 1000~31 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 3 client.4668 preadv(0x5611a1182140, 1000) = 0 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 3 client.4668 ll_release (fh)0x5611a1182140 0x10000000000 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 8 client.4668 _release_fh 0x5611a1182140 mode 3 on 0x10000000000.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=1} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 _flush 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 nothing to flush 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 check_caps on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) wanted - used Fc issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 delaying cap release 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 cap_delay_requeue on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 _release_fh 0x5611a1182140 on inode 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) no async_err state 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 3 client.4668 ll_unlink 0x1.head test_llreadvllwritevfile44572 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50); ; name test_llreadvllwritevfile44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 _getattr mask As issued=1 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 3 client.4668 may_delete 0x7f00f000ca50 = 0 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 8 client.4668 _unlink(0x1 test_llreadvllwritevfile44572 uid 0 gid 0) 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) name test_llreadvllwritevfile44572 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 _lookup have 0x1.head["test_llreadvllwritevfile44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:12.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) test_llreadvllwritevfile44572 = 0x10000000000.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 choose_target_mds inode dir hash is 2 on test_llreadvllwritevfile44572 => 568492468 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50) is_hash=1 hash=568492468 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 choose_target_mds from dirfragtree hash 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 mds is 0 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 encode_cap_releases enter (req: 0x5611a124cdd0, mds: 0) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 encode_inode_release enter(in:0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840), req:0x5611a124cdd0 mds:0, drop:LsxXx, unless:-, force:0) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 encode_dentry_release enter(dn:0x7f00f0009730) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f000ca50), req:0x5611a124cdd0 mds:0, drop:Fs, unless:Fx, force:1) 2024-03-23T23:58:12.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 send_request set sent_stamp to 2024-03-23T23:58:12.687715+0000 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 10 client.4668 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevfile44572 2024-03-23T23:58:12.687680+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevfile44572 2024-03-23T23:58:12.687680+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a124d2c0 con 0x5611a13a59d0 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.686+0000 7f010c985480 20 client.4668 awaiting reply|forward|kick on 0x7ffef7334530 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(revoke ino 0x10000000000 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 1031/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:12.681460+0000 ctime 2024-03-23T23:58:12.681460+0000 change_attr 3) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc042040 con 0x5611a13a59d0 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 mds.0 seq now 2 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 5 client.4668 handle_cap_grant on in 0x10000000000 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsFsxcrwb 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) pAsxXsFsxcrwb ctime 2024-03-23T23:58:12.681460+0000 mtime 2024-03-23T23:58:12.681460+0000 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 revocation of Ax 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 check_caps on 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) wanted - used Fc issued pAsXsFsxcrwb revoking Ax flags=1 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsFsxcrwb revoking Ax 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 completed revocation of Ax 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 send_cap 0x10000000000.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevfile44572"] 0x7f00f0015840) mds.0 seq 2 used Fc want - flush - retain pAsLsXsFsc held pAsxXsFsxcrwb revoking Ax dropping Fxrwb 2024-03-23T23:58:12.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 15 client.4668 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000000 1 seq 2 caps=pAsXsFsc dirty=- wanted=- follows 0 size 1031/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:12.681460+0000 ctime 2024-03-23T23:58:12.681460+0000 change_attr 3) v12 -- 0x7f00d8002f90 con 0x5611a13a59d0 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.687+0000 7f0102000640 10 client.4668 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:3 = 0 (0) Success unsafe) v1 ==== 498+0+0 (crc 0 0 0) 0x7f00fc009bd0 con 0x5611a13a59d0 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 handle_client_reply got a reply. Safe:0 tid 3 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 insert_trace from 2024-03-23T23:58:12.687715+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 features 0xffffffffffffffff 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 update_snap_trace len 70 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref was 2 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 get_snap_realm 0x1 0x7f00f000c960, nref now is 3 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 hrm is_target=0 is_dentry=1 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 12 client.4668 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) caps pAsLsXs 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.668219+0000 ctime=2024-03-23T23:58:12.668219+0000 change_attr=1 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) pAsLsXs ctime 2024-03-23T23:58:12.687680+0000 mtime 2024-03-23T23:58:12.687680+0000 2024-03-23T23:58:12.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 dir hash is 2 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 12 client.4668 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 2 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 15 client.4668 unlink dir 0x7f00f000ca50 'test_llreadvllwritevfile44572' dn 0x7f00f0009730 inode 0x7f00f0015840 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 unlink inode 0x7f00f0015840 parents now 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 put_snap_realm 0x1 0x7f00f000c960 3 -> 2 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 handle_client_reply signalling caller 0x7ffef7334530 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 20 client.4668 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 20 client.4668 lat 0.003057 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 20 client.4668 trim_cache size 1 max 16384 2024-03-23T23:58:12.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 8 client.4668 unlink(#0x1/test_llreadvllwritevfile44572) = 0 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=1 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 2 client.4668 unmount 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 2 client.4668 unmounting 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a127c880 con 0x5611a13a59d0 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 10 client.4668 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 unmounting: trim pass, size was 1+2 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 20 client.4668 trim_cache size 1 max 16384 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f0102000640 10 client.4668 unmounting: trim pass, size still 1+2 2024-03-23T23:58:12.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.689+0000 7f010c985480 10 client.4668 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_caps(grant ino 0x10000000000 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 1031/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:12.681460+0000 ctime 2024-03-23T23:58:12.687680+0000 change_attr 4) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d8002f90 con 0x5611a13a59d0 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 mds.0 seq now 3 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 5 client.4668 handle_cap_grant on in 0x10000000000 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFsc 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 update_inode_file_time 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/4194304 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.681460+0000 change_attr=3 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) pAsXsFsc ctime 2024-03-23T23:58:12.687680+0000 mtime 2024-03-23T23:58:12.681460+0000 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 max_size 4194304 -> 0 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 grant, new caps are LsFxrwb 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 5 client.4668 _try_to_trim_inode in 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 unmounting: trim pass, size was 1+2 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 20 client.4668 trim_cache size 1 max 16384 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 unmounting: trim pass, size still 1+2 2024-03-23T23:58:12.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc00f450 con 0x5611a13a59d0 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 20 client.4668 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 insert_trace from 2024-03-23T23:58:12.687715+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 unmounting: trim pass, size was 1+2 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 20 client.4668 trim_cache size 1 max 16384 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 15 client.4668 trim_dentry unlinking dn test_llreadvllwritevfile44572 in dir 0x1 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 15 client.4668 unlink dir 0x7f00f000ca50 'test_llreadvllwritevfile44572' dn 0x7f00f0009730 inode 0 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 15 client.4668 unlink removing 'test_llreadvllwritevfile44572' dn 0x7f00f0009730 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 15 client.4668 close_dir dir 0x5611a13a8710 on 0x7f00f000ca50 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _ll_drop_pins 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 _ll_put 0x7f00f0015840 0x10000000000 1 -> 0 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 _ll_put 0x7f00f000ca50 0x1 2 -> 0 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 _release 0x10000000000.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _invalidate_inode_cache 0x10000000000.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0015840) 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _flush 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) 2024-03-23T23:58:12.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 nothing to flush 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 nothing to flush 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) n = 1 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 1 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 flush_caps_sync 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 trim_cache size 0 max 16384 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) n = 11 2024-03-23T23:58:12.712 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(grant ino 0x10000000000 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 1031/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:12.681460+0000 ctime 2024-03-23T23:58:12.687680+0000 change_attr 4) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc022030 con 0x5611a13a59d0 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 15 client.4668 remove_cap last one, closing snaprealm 0x7f00f000c960 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_snap_realm 0x1 0x7f00f000c960 2 -> 1 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=- has_dir_layout 0x7f00f000ca50) 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _put_inode on 0x10000000000.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) n = 19 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 remove_cap mds.0 on 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 15 client.4668 remove_cap last one, closing snaprealm 0x7f00f000c960 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 20 client.4668 put_snap_realm 0x1 0x7f00f000c960 1 -> 0 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 10 client.4668 _put_inode deleting 0x10000000000.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=1031/0 nlink=0 btime=2024-03-23T23:58:12.668219+0000 mtime=2024-03-23T23:58:12.681460+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=4 caps=- objectset[0x10000000000 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0015840) 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 2 client.4668 _close_mds_session mds.0 seq 3 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 3) v7 -- 0x5611a1249420 con 0x5611a13a59d0 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f010c985480 2 client.4668 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:12.713 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 mds.0 seq now 4 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 4) v7 -- 0x7f00f000c740 con 0x5611a13a59d0 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 5 client.4668 handle_caps don't have vino 0x10000000000.head op 0, immediately releasing 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_cap_release(3) v2 -- 0x5611a1249270 con 0x5611a13a59d0 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 unmounting: trim pass, size was 0+0 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 20 client.4668 trim_cache size 0 max 16384 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.696+0000 7f0102000640 10 client.4668 unmounting: trim pass, size still 0+0 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f000c740 con 0x5611a13a59d0 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 10 client.4668 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 5 client.4668 _closed_mds_session mds.0 seq 4 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 1 -- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 msgr2=0x5611a12758a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a59d0 0x5611a12758a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 10 client.4668 remove_session_caps mds.0 2024-03-23T23:58:12.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 10 client.4668 kick_requests_closed for mds.0 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 10 client.4668 unmounting: trim pass, size was 0+0 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 20 client.4668 trim_cache size 0 max 16384 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f0102000640 10 client.4668 unmounting: trim pass, size still 0+0 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f010c985480 2 client.4668 unmounted. 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.701+0000 7f010c985480 1 client.4668 shutdown 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a124a280 msgr2=0x5611a124c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010c985480 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a124a280 0x5611a124c710 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13131b0 msgr2=0x5611a13019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010c985480 1 --2- 172.21.15.31:0/2960044418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13131b0 0x5611a13019d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0104003370 tx=0x7f010400d8f0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010a600640 1 -- 172.21.15.31:0/2960044418 reap_dead start 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 shutdown_connections 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 >> 172.21.15.31:0/2960044418 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.702+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 shutdown_connections 2024-03-23T23:58:12.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.703+0000 7f010c985480 1 -- 172.21.15.31:0/2960044418 wait complete. 2024-03-23T23:58:12.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.703+0000 7f010c985480 20 client.4668 trim_cache size 0 max 16384 2024-03-23T23:58:12.716 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritev (62 ms) 2024-03-23T23:58:12.716 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritevNullContext 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.704+0000 7f010c985480 1 -- start start 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.704+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.705+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 0x5611a12f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.705+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a2c10 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.705+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1313190 0x5611a13a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.705+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0004d00 con 0x5611a1313190 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.705+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a9830 con 0x5611a13a2c10 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.705+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a139d9c0 con 0x5611a1278730 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.705+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1313190 0x5611a13a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1313190 0x5611a13a44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53244/0 (socket says 172.21.15.31:53244) 2024-03-23T23:58:12.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010a600640 1 -- 172.21.15.31:0/629920603 learned_addr learned my addr 172.21.15.31:0/629920603 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f0109c00640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 0x5611a12f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f0103e00640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a2c10 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010a600640 1 -- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 msgr2=0x5611a12f6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010a600640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 0x5611a12f6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010a600640 1 -- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a2c10 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010a600640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a2c10 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010a600640 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a127e540 con 0x5611a1313190 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010c985480 10 client.4671 Subscribing to map 'mdsmap' 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.706+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a12f8bb0 con 0x5611a1313190 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f00faa00640 20 client.4671 tick 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f00faa00640 20 client.4671 collect_and_send_metrics 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f00faa00640 20 client.4671 collect_and_send_global_metrics 2024-03-23T23:58:12.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f00faa00640 5 client.4671 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f00faa00640 20 client.4671 trim_cache size 0 max 16384 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f00faa00640 20 client.4671 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010a600640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1313190 0x5611a13a44b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5611a1309320 tx=0x7f0104022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d41578cc4b2908c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f0103400640 10 client.4671 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104024480 con 0x5611a1313190 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f010402ca50 con 0x5611a1313190 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010402cc50 con 0x5611a1313190 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f0103400640 1 client.4671 handle_mds_map epoch 8 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010c985480 20 client.4671 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010c985480 10 client.4671 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010c985480 20 client.4671 mds is 0 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010c985480 10 client.4671 _open_mds_session mds.0 2024-03-23T23:58:12.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010c985480 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1276f10 0x5611a13019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13020d0 con 0x5611a1276f10 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.707+0000 7f010c985480 10 client.4671 waiting for session to mds.0 to open 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.708+0000 7f0109c00640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1276f10 0x5611a13019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.709+0000 7f0109c00640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1276f10 0x5611a13019d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb125c4678c4c9c server_cookie=8bc745896031d12b in_seq=0 out_seq=0 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.709+0000 7f0103400640 10 client.4671 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a13020d0 con 0x5611a1276f10 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f0103400640 10 client.4671 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f0103400640 10 client.4671 renew_caps mds.0 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0006090 con 0x5611a1276f10 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f0103400640 10 client.4671 connect_mds_targets for mds.0 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 10 client.4671 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 20 client.4671 mds is 0 2024-03-23T23:58:12.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 10 client.4671 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 20 client.4671 encode_cap_releases enter (req: 0x5611a1276be0, mds: 0) 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 20 client.4671 send_request set sent_stamp to 2024-03-23T23:58:12.714395+0000 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 10 client.4671 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.708864+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:12.708864+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1249900 con 0x5611a1276f10 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f010c985480 20 client.4671 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0006090 con 0x5611a1276f10 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.713+0000 7f0103400640 10 client.4671 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00b310 con 0x5611a1276f10 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 insert_trace from 2024-03-23T23:58:12.714395+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 features 0xffffffffffffffff 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 update_snap_trace len 70 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:12.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 get_snap_realm 0x1 0x7f00f00062b0, nref now is 1 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 15 client.4671 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 15 client.4671 snapc 1=[] 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 put_snap_realm 0x1 0x7f00f00062b0 2 -> 1 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 hrm is_target=1 is_dentry=0 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0015840) - ctime 2024-03-23T23:58:12.687680+0000 mtime 2024-03-23T23:58:12.687680+0000 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 dir hash is 2 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 12 client.4671 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 2 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 12 client.4671 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=- has_dir_layout 0x7f00f0015840) caps pAsLsXsFs 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 get_snap_realm 0x1 0x7f00f00062b0, nref was 1 2024-03-23T23:58:12.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 get_snap_realm 0x1 0x7f00f00062b0, nref now is 2 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 15 client.4671 add_update_cap first one, opened snaprealm 0x7f00f00062b0 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015840) 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 add_update_cap calling signal_caps_inode 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015840) 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 put_snap_realm 0x1 0x7f00f00062b0 2 -> 1 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 lat 0.001001 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 _ll_get 0x7f00f0015840 0x1 -> 1 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 2 client.4671 unmount 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 2 client.4671 unmounting 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a1249c50 con 0x5611a1276f10 2024-03-23T23:58:12.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 10 client.4671 _ll_drop_pins 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 _ll_put 0x7f00f0015840 0x1 1 -> 0 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 10 client.4671 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 10 client.4671 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 10 client.4671 nothing to flush 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 10 client.4671 flush_caps_sync 2024-03-23T23:58:12.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 10 client.4671 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 20 client.4671 trim_cache size 0 max 16384 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 10 client.4671 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 6 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 2 client.4671 cache still has 0+1 items, waiting (for caps to release?) 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 1 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 unmounting: trim pass, size was 0+1 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 20 client.4671 trim_cache size 0 max 16384 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f0103400640 10 client.4671 unmounting: trim pass, size still 0+1 2024-03-23T23:58:12.728 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:12.714+0000 7f010c985480 2 client.4671 cache still has 0+1 items, waiting (for caps to release?) 2024-03-23T23:58:13.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 20 client.4671 tick 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 10 client.4671 renew_caps() 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 15 client.4671 renew_caps requesting from mds.0 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 10 client.4671 renew_caps mds.0 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 2) v7 -- 0x7f00d80021a0 con 0x5611a1276f10 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 20 client.4671 collect_and_send_metrics 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 20 client.4671 collect_and_send_global_metrics 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.001001, avg_latency: 0.001001, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 0 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 -- 0x7f00d80032a0 con 0x5611a1276f10 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 10 client.4671 _put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) n = 2 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 10 client.4671 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015840) 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 15 client.4671 remove_cap last one, closing snaprealm 0x7f00f00062b0 2024-03-23T23:58:13.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 20 client.4671 put_snap_realm 0x1 0x7f00f00062b0 1 -> 0 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 10 client.4671 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=- COMPLETE has_dir_layout 0x7f00f0015840) 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 20 client.4671 trim_cache size 0 max 16384 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f00faa00640 20 client.4671 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f010c985480 2 client.4671 _close_mds_session mds.0 seq 0 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a1249e70 con 0x5611a1276f10 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f010c985480 2 client.4671 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(renewcaps seq 2) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1249e70 con 0x5611a1276f10 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f0103400640 10 client.4671 handle_client_session client_session(renewcaps seq 2) v1 from mds.0 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f0103400640 10 client.4671 unmounting: trim pass, size was 0+0 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f0103400640 20 client.4671 trim_cache size 0 max 16384 2024-03-23T23:58:13.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.708+0000 7f0103400640 10 client.4671 unmounting: trim pass, size still 0+0 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d80021a0 con 0x5611a1276f10 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 10 client.4671 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 5 client.4671 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 1 -- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1276f10 msgr2=0x5611a13019d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1276f10 0x5611a13019d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 10 client.4671 remove_session_caps mds.0 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 10 client.4671 kick_requests_closed for mds.0 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 10 client.4671 unmounting: trim pass, size was 0+0 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 20 client.4671 trim_cache size 0 max 16384 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f0103400640 10 client.4671 unmounting: trim pass, size still 0+0 2024-03-23T23:58:13.714 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f010c985480 2 client.4671 unmounted. 2024-03-23T23:58:13.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.713+0000 7f010c985480 1 client.4671 shutdown 2024-03-23T23:58:13.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1313190 msgr2=0x5611a13a44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1313190 0x5611a13a44b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x5611a1309320 tx=0x7f0104022000 comp rx=0 tx=0).stop 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 shutdown_connections 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1276f10 0x5611a13019d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a2c10 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1313190 0x5611a13a44b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 --2- 172.21.15.31:0/629920603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 0x5611a12f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 >> 172.21.15.31:0/629920603 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.714+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 shutdown_connections 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.715+0000 7f010c985480 1 -- 172.21.15.31:0/629920603 wait complete. 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.715+0000 7f010c985480 20 client.4671 trim_cache size 0 max 16384 2024-03-23T23:58:13.716 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.716+0000 7f010c985480 1 -- start start 2024-03-23T23:58:13.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.717+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:13.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.717+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1276f10 0x5611a13019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.717+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.717+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1313190 0x5611a139df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.717+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0008240 con 0x5611a1276f10 2024-03-23T23:58:13.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.717+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a1da0 con 0x5611a1313190 2024-03-23T23:58:13.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.717+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a1f50 con 0x5611a1278730 2024-03-23T23:58:13.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.718+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1276f10 0x5611a13019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.718+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1276f10 0x5611a13019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53260/0 (socket says 172.21.15.31:53260) 2024-03-23T23:58:13.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.718+0000 7f0109c00640 1 -- 172.21.15.31:0/1355172560 learned_addr learned my addr 172.21.15.31:0/1355172560 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:13.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.718+0000 7f0103e00640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.718+0000 7f010a600640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1313190 0x5611a139df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0109c00640 1 -- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0109c00640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278730 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0109c00640 1 -- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1313190 msgr2=0x5611a139df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0109c00640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1313190 0x5611a139df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0109c00640 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1312e60 con 0x5611a1276f10 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f010a600640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1313190 0x5611a139df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0109c00640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1276f10 0x5611a13019d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000fd0 tx=0x7f00fc001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6bc49010bf41ba server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d80032a0 con 0x5611a1276f10 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00fc009cf0 con 0x5611a1276f10 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f010c985480 10 client.4674 Subscribing to map 'mdsmap' 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.719+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a1276300 con 0x5611a1276f10 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f00fb400640 20 client.4674 tick 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f00fb400640 20 client.4674 collect_and_send_metrics 2024-03-23T23:58:13.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f00fb400640 20 client.4674 collect_and_send_global_metrics 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f00fb400640 5 client.4674 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f00fb400640 20 client.4674 trim_cache size 0 max 16384 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f00fb400640 20 client.4674 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611a1249270 con 0x5611a1276f10 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc04c040 con 0x5611a1276f10 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f0102000640 1 client.4674 handle_mds_map epoch 8 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f010c985480 20 client.4674 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f010c985480 10 client.4674 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f010c985480 20 client.4674 mds is 0 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f010c985480 10 client.4674 _open_mds_session mds.0 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f010c985480 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a2c10 0x5611a13a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1249e70 con 0x5611a13a2c10 2024-03-23T23:58:13.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.720+0000 7f010c985480 10 client.4674 waiting for session to mds.0 to open 2024-03-23T23:58:13.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.721+0000 7f0103e00640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a2c10 0x5611a13a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.722+0000 7f0103e00640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a2c10 0x5611a13a81e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664e546e27da62fb server_cookie=200db854c94b2a1a in_seq=0 out_seq=0 2024-03-23T23:58:13.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.722+0000 7f0102000640 10 client.4674 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1249e70 con 0x5611a13a2c10 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f0102000640 10 client.4674 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f0102000640 10 client.4674 renew_caps mds.0 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0015840 con 0x5611a13a2c10 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f0102000640 10 client.4674 connect_mds_targets for mds.0 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 10 client.4674 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 20 client.4674 mds is 0 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 10 client.4674 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 20 client.4674 encode_cap_releases enter (req: 0x5611a13a7dd0, mds: 0) 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 20 client.4674 send_request set sent_stamp to 2024-03-23T23:58:13.729856+0000 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 10 client.4674 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:13.721442+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:13.721442+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f4000 con 0x5611a13a2c10 2024-03-23T23:58:13.729 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.728+0000 7f010c985480 20 client.4674 awaiting reply|forward|kick on 0x7ffef7334690 2024-03-23T23:58:13.730 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.729+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0015840 con 0x5611a13a2c10 2024-03-23T23:58:13.730 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.729+0000 7f0102000640 10 client.4674 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:13.731 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f404ac50 con 0x5611a13a2c10 2024-03-23T23:58:13.731 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:13.731 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 insert_trace from 2024-03-23T23:58:13.729856+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:13.731 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 features 0xffffffffffffffff 2024-03-23T23:58:13.731 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 update_snap_trace len 70 2024-03-23T23:58:13.731 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref now is 1 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 15 client.4674 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 15 client.4674 snapc 1=[] 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 put_snap_realm 0x1 0x7f00f00063c0 2 -> 1 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 hrm is_target=1 is_dentry=0 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0015a60) - ctime 2024-03-23T23:58:12.687680+0000 mtime 2024-03-23T23:58:12.687680+0000 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 dir hash is 2 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 12 client.4674 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 2 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 12 client.4674 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=- has_dir_layout 0x7f00f0015a60) caps pAsLsXsFs 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref was 1 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref now is 2 2024-03-23T23:58:13.732 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 15 client.4674 add_update_cap first one, opened snaprealm 0x7f00f00063c0 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 add_update_cap calling signal_caps_inode 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 10 client.4674 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 put_snap_realm 0x1 0x7f00f00063c0 2 -> 1 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 handle_client_reply signalling caller 0x7ffef7334690 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 lat 0.001414 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 _ll_get 0x7f00f0015a60 0x1 -> 1 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 8 client.4674 _ll_create 0x1.head test_llreadvllwritevnullcontextfile44572 0666 578, uid 0, gid 0 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 10 client.4674 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60) dn 'test_llreadvllwritevnullcontextfile44572' 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 10 client.4674 _getattr mask As issued=1 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 3 client.4674 may_create 0x7f00f0015a60 = 0 2024-03-23T23:58:13.733 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 8 client.4674 _create(0x1 test_llreadvllwritevnullcontextfile44572, 0666) 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60) name test_llreadvllwritevnullcontextfile44572 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 15 open_dir 0x5611a1276c90 on 0x7f00f0015a60 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 15 client.4674 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60) 'test_llreadvllwritevnullcontextfile44572' dn 0x1.head["test_llreadvllwritevnullcontextfile44572"] (new dn) 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnullcontextfile44572 => 2058642720 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60) is_hash=1 hash=2058642720 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 10 client.4674 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 mds is 0 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 10 client.4674 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 encode_cap_releases enter (req: 0x5611a12f4330, mds: 0) 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 encode_dentry_release enter(dn:0x5611a11fa9f0) 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015a60), req:0x5611a12f4330 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:13.734 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 send_request set sent_stamp to 2024-03-23T23:58:13.731438+0000 2024-03-23T23:58:13.735 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 10 client.4674 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnullcontextfile44572 2024-03-23T23:58:13.731375+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:13.735 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnullcontextfile44572 2024-03-23T23:58:13.731375+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f4820 con 0x5611a13a2c10 2024-03-23T23:58:13.735 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f010c985480 20 client.4674 awaiting reply|forward|kick on 0x7ffef73344d0 2024-03-23T23:58:13.735 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.735 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.730+0000 7f0102000640 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.738 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.736+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 861+0+0 (crc 0 0 0) 0x7f00f4052ba0 con 0x5611a13a2c10 2024-03-23T23:58:13.738 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:13.738 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 insert_trace from 2024-03-23T23:58:13.731438+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:13.738 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 features 0xffffffffffffffff 2024-03-23T23:58:13.738 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 update_snap_trace len 70 2024-03-23T23:58:13.738 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref was 1 2024-03-23T23:58:13.738 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref now is 2 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 hrm is_target=1 is_dentry=1 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) - ctime 2024-03-23T23:58:13.731375+0000 mtime 2024-03-23T23:58:13.731375+0000 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 12 client.4674 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 12 client.4674 add_update_inode adding 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref was 2 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref now is 3 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 15 client.4674 add_update_cap first one, opened snaprealm 0x7f00f00063c0 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 add_update_cap calling signal_caps_inode 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 12 client.4674 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015a60) caps pAsLsXsFs 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:12.687680+0000 ctime=2024-03-23T23:58:12.687680+0000 change_attr=2 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015a60) pAsLsXs ctime 2024-03-23T23:58:13.731375+0000 mtime 2024-03-23T23:58:13.731375+0000 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 dir hash is 2 2024-03-23T23:58:13.739 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 12 client.4674 add_update_inode client inode change_attr: 2 , mds inodestat change_attr: 3 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 clearing (I_COMPLETE|I_DIR_ORDERED) on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 10 client.4674 add_update_cap calling signal_caps_inode 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 12 client.4674 insert_dentry_inode 'test_llreadvllwritevnullcontextfile44572' vino 0x10000000001.head in dir 0x1.head dn 0x5611a11fa9f0 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 15 client.4674 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) 'test_llreadvllwritevnullcontextfile44572' to inode 0x7f00f0016040 dn 0x1.head["test_llreadvllwritevnullcontextfile44572"] (old dn) 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 link inode 0x7f00f0016040 parents now 0x1.head["test_llreadvllwritevnullcontextfile44572"] 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 15 client.4674 update_dentry_lease 0x1.head["test_llreadvllwritevnullcontextfile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:13.731438+0000 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 put_snap_realm 0x1 0x7f00f00063c0 3 -> 2 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 handle_client_reply signalling caller 0x7ffef73344d0 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:13.740 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 client.4674 delegated_inos: [] 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 client.4674 make_request created ino 0x10000000001 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 make_request target is 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 lat 0.006765 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000001.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 client.4674 _create_fh 0x10000000001 mode 3 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 trim_cache size 1 max 16384 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 8 client.4674 create(#0x1/test_llreadvllwritevnullcontextfile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 _ll_create created = 1 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 8 client.4674 _ll_create 0x1.head test_llreadvllwritevnullcontextfile44572 0666 578 = 0 (0x5611a12f4bd0 10000000001) 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 _ll_get 0x7f00f0016040 0x10000000001 -> 1 2024-03-23T23:58:13.741 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 client.4674 fill_statx on 0x10000000001 snap/devhead mode 0100666 mtime 2024-03-23T23:58:13.731375+0000 ctime 2024-03-23T23:58:13.731375+0000 change_attr 0 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 client.4674 get_quota_root realm 0x1 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 client.4674 get_quota_root 0x10000000001.head -> 0x1.head 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 10 client.4674 cur file size is 0 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x5611a13aead0 0x5611a13b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] -- osd_op(unknown.0.0:1 3.7 3:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x5611a13b1580 con 0x5611a13aead0 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] -- osd_op(unknown.0.0:2 3.7 3:e2e07930:::10000000001.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x5611a13b1f10 con 0x5611a13aead0 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f0102000640 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.737+0000 7f010a600640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x5611a13aead0 0x5611a13b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.738+0000 7f010a600640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x5611a13aead0 0x5611a13b0ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=65e3ace3f54a56aa server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.742 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.738+0000 7f0102000640 10 client.4674 ms_handle_connect on v2:172.21.15.31:6808/636958187 2024-03-23T23:58:13.747 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.739+0000 7f010a600640 1 -- 172.21.15.31:0/1355172560 <== osd.2 v2:172.21.15.31:6808/636958187 1 ==== osd_op_reply(1 10000000001.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104030020 con 0x5611a13aead0 2024-03-23T23:58:13.747 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010a600640 1 -- 172.21.15.31:0/1355172560 <== osd.2 v2:172.21.15.31:6808/636958187 2 ==== osd_op_reply(2 10000000001.00000000 [create] v23'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104030020 con 0x5611a13aead0 2024-03-23T23:58:13.747 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 wanted_max_size 0 -> 14 2024-03-23T23:58:13.747 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 get_caps 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 clear_suid_sgid 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 5 client.4674 get_cap_ref got first FILE_BUFFER ref on 0x10000000001.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={4=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 5 client.4674 get_cap_ref got first FILE_CACHE ref on 0x10000000001.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={4=0,1024=0,4096=1,8192=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 mark_caps_dirty 0x10000000001.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) - -> Fw 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 get_quota_root realm 0x1 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 get_quota_root 0x10000000001.head -> 0x1.head 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 7 client.4674 wrote to 14, extending file size 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 mark_caps_dirty 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) Fw -> Fw 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=1,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 3 client.4674 pwritev(0x5611a12f4bd0, "...", 14, 0) = 14 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 get_caps 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-03-23T23:58:13.748 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 _read_async 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=1,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 0~14 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 min_bytes=131072 max_bytes=16777216 max_periods=4 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 3 client.4674 preadv(0x5611a12f4bd0, 0) = 14 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 3 client.4674 ll_release (fh)0x5611a12f4bd0 0x10000000001 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 8 client.4674 _release_fh 0x5611a12f4bd0 mode 3 on 0x10000000001.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=1} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 _flush 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] -- osd_op(unknown.0.0:3 3.7 3:e2e07930:::10000000001.00000000:head [write 0~14 in=14b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x5611a13b2350 con 0x5611a13aead0 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 check_caps on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 delaying cap release 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 cap_delay_requeue on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 _release_fh 0x5611a12f4bd0 on inode 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) no async_err state 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.749 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 3 client.4674 ll_unlink 0x1.head test_llreadvllwritevnullcontextfile44572 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60); ; name test_llreadvllwritevnullcontextfile44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 _getattr mask As issued=1 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 3 client.4674 may_delete 0x7f00f0015a60 = 0 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 8 client.4674 _unlink(0x1 test_llreadvllwritevnullcontextfile44572 uid 0 gid 0) 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) name test_llreadvllwritevnullcontextfile44572 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 _lookup have 0x1.head["test_llreadvllwritevnullcontextfile44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) test_llreadvllwritevnullcontextfile44572 = 0x10000000001.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnullcontextfile44572 => 2058642720 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60) is_hash=1 hash=2058642720 2024-03-23T23:58:13.750 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 choose_target_mds from dirfragtree hash 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 mds is 0 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 10 client.4674 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 encode_cap_releases enter (req: 0x5611a13b26f0, mds: 0) 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.742+0000 7f010c985480 20 client.4674 encode_inode_release enter(in:0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040), req:0x5611a13b26f0 mds:0, drop:LsxXx, unless:-, force:0) 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f010c985480 20 client.4674 encode_dentry_release enter(dn:0x5611a11fa9f0) 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f010c985480 20 client.4674 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015a60), req:0x5611a13b26f0 mds:0, drop:Fs, unless:Fx, force:1) 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f010c985480 20 client.4674 send_request set sent_stamp to 2024-03-23T23:58:13.744045+0000 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f010c985480 10 client.4674 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevnullcontextfile44572 2024-03-23T23:58:13.743946+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevnullcontextfile44572 2024-03-23T23:58:13.743946+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13b2a20 con 0x5611a13a2c10 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f010c985480 20 client.4674 awaiting reply|forward|kick on 0x7ffef73346b0 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_caps(revoke ino 0x10000000001 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:13.731375+0000 ctime 2024-03-23T23:58:13.731375+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f4066740 con 0x5611a13a2c10 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 5 client.4674 set_cap_epoch_barrier epoch = 21 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 mds.0 seq now 1 2024-03-23T23:58:13.751 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 5 client.4674 handle_cap_grant on in 0x10000000001 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsFsxcrwb 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) pAsxXsFsxcrwb ctime 2024-03-23T23:58:13.731375+0000 mtime 2024-03-23T23:58:13.731375+0000 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 revocation of Ax 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 check_caps on 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking Ax flags=1 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsFsxcrwb revoking Ax 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 completed revocation of Ax 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 mark_caps_flushing Fw 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 mark_caps_clean 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 10 client.4674 send_cap 0x10000000001.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] parents=0x1.head["test_llreadvllwritevnullcontextfile44572"] 0x7f00f0016040) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsxFsxcrwbl held pAsxXsFsxcrwb revoking Ax dropping - 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 15 client.4674 auth cap, requesting max_size 14 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.743+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000001 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 14/14 ts 1/18446744073709551615 mtime 2024-03-23T23:58:13.743441+0000 ctime 2024-03-23T23:58:13.743441+0000 change_attr 1) v12 -- 0x7f00f0016620 con 0x5611a13a2c10 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.744+0000 7f0102000640 10 client.4674 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_reply(???:3 = 0 (0) Success unsafe) v1 ==== 509+0+0 (crc 0 0 0) 0x7f00f4019a30 con 0x5611a13a2c10 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 handle_client_reply got a reply. Safe:0 tid 3 2024-03-23T23:58:13.752 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 10 client.4674 insert_trace from 2024-03-23T23:58:13.744045+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 10 client.4674 features 0xffffffffffffffff 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 10 client.4674 update_snap_trace len 70 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref was 2 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 get_snap_realm 0x1 0x7f00f00063c0, nref now is 3 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 10 client.4674 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 10 client.4674 hrm is_target=0 is_dentry=1 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 12 client.4674 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) caps pAsLsXs 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 10 client.4674 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.731375+0000 ctime=2024-03-23T23:58:13.731375+0000 change_attr=3 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) pAsLsXs ctime 2024-03-23T23:58:13.743946+0000 mtime 2024-03-23T23:58:13.743946+0000 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 dir hash is 2 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 12 client.4674 add_update_inode client inode change_attr: 3 , mds inodestat change_attr: 4 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 10 client.4674 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 15 client.4674 unlink dir 0x7f00f0015a60 'test_llreadvllwritevnullcontextfile44572' dn 0x5611a11fa9f0 inode 0x7f00f0016040 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.753 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 unlink inode 0x7f00f0016040 parents now 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 put_snap_realm 0x1 0x7f00f00063c0 3 -> 2 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 handle_client_reply signalling caller 0x7ffef73346b0 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f0102000640 20 client.4674 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 20 client.4674 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 20 client.4674 lat 0.002810 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 20 client.4674 trim_cache size 1 max 16384 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 8 client.4674 unlink(#0x1/test_llreadvllwritevnullcontextfile44572) = 0 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 14] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 2 client.4674 unmount 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 2 client.4674 unmounting 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.745+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a13b2e00 con 0x5611a13a2c10 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.746+0000 7f010c985480 10 client.4674 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:13.754 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.746+0000 7f0102000640 10 client.4674 unmounting: trim pass, size was 1+2 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.746+0000 7f0102000640 20 client.4674 trim_cache size 1 max 16384 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.746+0000 7f0102000640 10 client.4674 unmounting: trim pass, size still 1+2 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.746+0000 7f010c985480 10 client.4674 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.747+0000 7f010a600640 1 -- 172.21.15.31:0/1355172560 <== osd.2 v2:172.21.15.31:6808/636958187 3 ==== osd_op_reply(3 10000000001.00000000 [write 0~14] v23'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104030020 con 0x5611a13aead0 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.747+0000 7f0100c00640 10 client.4674 _flushed 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=1,2048=0,4096=0,8192=1} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.747+0000 7f0100c00640 5 client.4674 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.747+0000 7f0100c00640 5 client.4674 put_cap_ref dropped last FILE_CACHE ref on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.747+0000 7f0100c00640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) n = 2 2024-03-23T23:58:13.755 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.747+0000 7f0100c00640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=1 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.759 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_caps(grant ino 0x10000000001 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=LsFxcb follows 0 size 14/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:13.743441+0000 ctime 2024-03-23T23:58:13.743946+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f0016620 con 0x5611a13a2c10 2024-03-23T23:58:13.759 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 mds.0 seq now 2 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 5 client.4674 handle_cap_grant on in 0x10000000001 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFsxcrwb 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 update_inode_file_time 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743441+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) pAsXsFsxcrwb ctime 2024-03-23T23:58:13.743946+0000 mtime 2024-03-23T23:58:13.743441+0000 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 grant, new caps are Ls 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 5 client.4674 _try_to_trim_inode in 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 unmounting: trim pass, size was 1+2 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 20 client.4674 trim_cache size 1 max 16384 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 unmounting: trim pass, size still 1+2 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f4066aa0 con 0x5611a13a2c10 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 20 client.4674 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:13.761 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 insert_trace from 2024-03-23T23:58:13.744045+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 unmounting: trim pass, size was 1+2 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 20 client.4674 trim_cache size 1 max 16384 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 15 client.4674 trim_dentry unlinking dn test_llreadvllwritevnullcontextfile44572 in dir 0x1 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 15 client.4674 unlink dir 0x7f00f0015a60 'test_llreadvllwritevnullcontextfile44572' dn 0x5611a11fa9f0 inode 0 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 15 client.4674 unlink removing 'test_llreadvllwritevnullcontextfile44572' dn 0x5611a11fa9f0 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 15 client.4674 close_dir dir 0x5611a1276c90 on 0x7f00f0015a60 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f0102000640 10 client.4674 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:13.762 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 10 client.4674 _ll_drop_pins 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 _ll_put 0x7f00f0016040 0x10000000001 1 -> 0 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 _ll_put 0x7f00f0015a60 0x1 2 -> 0 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.751+0000 7f010c985480 20 client.4674 _release 0x10000000001.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _invalidate_inode_cache 0x10000000001.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_caps(flush_ack ino 0x10000000001 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f405f430 con 0x5611a13a2c10 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _flush 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 nothing to flush 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 nothing to flush 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 1 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 flush_caps_sync 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 waiting on mds.0 tid 2 (want 2) 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 10 client.4674 mds.0 seq now 3 2024-03-23T23:58:13.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 5 client.4674 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) with Fw 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 5 client.4674 flushing_caps Fw -> - 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 10 client.4674 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) !flushing 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 10 client.4674 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 20 client.4674 put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) n = 1 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 10 client.4674 unmounting: trim pass, size was 0+2 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 20 client.4674 trim_cache size 0 max 16384 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f0102000640 10 client.4674 unmounting: trim pass, size still 0+2 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 trim_cache size 0 max 16384 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) n = 11 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 15 client.4674 remove_cap last one, closing snaprealm 0x7f00f00063c0 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 put_snap_realm 0x1 0x7f00f00063c0 2 -> 1 2024-03-23T23:58:13.765 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=- has_dir_layout 0x7f00f0015a60) 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _put_inode on 0x10000000001.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) n = 18 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 remove_cap mds.0 on 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 15 client.4674 remove_cap last one, closing snaprealm 0x7f00f00063c0 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 20 client.4674 put_snap_realm 0x1 0x7f00f00063c0 1 -> 0 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 10 client.4674 _put_inode deleting 0x10000000001.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,2048=0,4096=0,8192=0} open={3=0} mode=100666 size=14/4194304 nlink=0 btime=2024-03-23T23:58:13.731375+0000 mtime=2024-03-23T23:58:13.743441+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=1 caps=- objectset[0x10000000001 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016040) 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 2 client.4674 _close_mds_session mds.0 seq 3 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 3) v7 -- 0x5611a13ae2c0 con 0x5611a13a2c10 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.752+0000 7f010c985480 2 client.4674 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.756+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a13ae2c0 con 0x5611a13a2c10 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.756+0000 7f0102000640 10 client.4674 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.756+0000 7f0102000640 5 client.4674 _closed_mds_session mds.0 seq 3 2024-03-23T23:58:13.766 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.756+0000 7f0102000640 1 -- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a2c10 msgr2=0x5611a13a81e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.756+0000 7f0102000640 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a2c10 0x5611a13a81e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.756+0000 7f0102000640 10 client.4674 remove_session_caps mds.0 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f0102000640 10 client.4674 kick_requests_closed for mds.0 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f0102000640 10 client.4674 unmounting: trim pass, size was 0+0 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f0102000640 20 client.4674 trim_cache size 0 max 16384 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f0102000640 10 client.4674 unmounting: trim pass, size still 0+0 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 2 client.4674 unmounted. 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 1 client.4674 shutdown 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x5611a13aead0 msgr2=0x5611a13b0ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x5611a13aead0 0x5611a13b0ec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1276f10 msgr2=0x5611a13019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 1 --2- 172.21.15.31:0/1355172560 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1276f10 0x5611a13019d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000fd0 tx=0x7f00fc001760 comp rx=0 tx=0).stop 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010a600640 1 -- 172.21.15.31:0/1355172560 reap_dead start 2024-03-23T23:58:13.767 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 shutdown_connections 2024-03-23T23:58:13.768 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.757+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 >> 172.21.15.31:0/1355172560 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:13.768 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.758+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 shutdown_connections 2024-03-23T23:58:13.768 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.758+0000 7f010c985480 1 -- 172.21.15.31:0/1355172560 wait complete. 2024-03-23T23:58:13.768 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.758+0000 7f010c985480 20 client.4674 trim_cache size 0 max 16384 2024-03-23T23:58:13.768 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritevNullContext (1055 ms) 2024-03-23T23:58:13.768 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritevOPathFileHandle 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.759+0000 7f010c985480 1 -- start start 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.759+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0006b70 con 0x5611a1249e70 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1276110 con 0x5611a12466d0 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a12762c0 con 0x5611a12fa280 2024-03-23T23:58:13.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53268/0 (socket says 172.21.15.31:53268) 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f010a600640 1 -- 172.21.15.31:0/3209603645 learned_addr learned my addr 172.21.15.31:0/3209603645 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.760+0000 7f0103e00640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f0109c00640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f010a600640 1 -- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f010a600640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f010a600640 1 -- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f010a600640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f010a600640 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a44b0 con 0x5611a1249e70 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f010a600640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0104003370 tx=0x7f00fc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775570a237577920 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.761+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043060 con 0x5611a1249e70 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f010400d6e0 con 0x5611a1249e70 2024-03-23T23:58:13.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 10 client.4677 Subscribing to map 'mdsmap' 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a12fa0b0 con 0x5611a1249e70 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f00faa00640 20 client.4677 tick 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f00faa00640 20 client.4677 collect_and_send_metrics 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f00faa00640 20 client.4677 collect_and_send_global_metrics 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f00faa00640 5 client.4677 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f00faa00640 20 client.4677 trim_cache size 0 max 16384 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f00faa00640 20 client.4677 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040249a0 con 0x5611a1249e70 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a1249e70 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f0103400640 1 client.4677 handle_mds_map epoch 8 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 20 client.4677 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 10 client.4677 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 20 client.4677 mds is 0 2024-03-23T23:58:13.774 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 10 client.4677 _open_mds_session mds.0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1301d00 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1308b10 con 0x5611a1301d00 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.762+0000 7f010c985480 10 client.4677 waiting for session to mds.0 to open 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.763+0000 7f0109c00640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1301d00 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.764+0000 7f0109c00640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1301d00 0x5611a13a7dd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4085c6251f12bd server_cookie=e52df70644b536f3 in_seq=0 out_seq=0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.764+0000 7f0103400640 10 client.4677 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1308b10 con 0x5611a1301d00 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f0103400640 10 client.4677 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f0103400640 10 client.4677 renew_caps mds.0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0015aa0 con 0x5611a1301d00 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f0103400640 10 client.4677 connect_mds_targets for mds.0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 10 client.4677 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 20 client.4677 mds is 0 2024-03-23T23:58:13.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 10 client.4677 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 20 client.4677 encode_cap_releases enter (req: 0x5611a13019d0, mds: 0) 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 20 client.4677 send_request set sent_stamp to 2024-03-23T23:58:13.769533+0000 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 10 client.4677 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:13.763907+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:13.763907+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f6bf0 con 0x5611a1301d00 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f010c985480 20 client.4677 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0015aa0 con 0x5611a1301d00 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.768+0000 7f0103400640 10 client.4677 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc03d040 con 0x5611a1301d00 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 insert_trace from 2024-03-23T23:58:13.769533+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 features 0xffffffffffffffff 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 update_snap_trace len 70 2024-03-23T23:58:13.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 get_snap_realm 0x1 0x7f00f0015cc0, nref now is 1 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 15 client.4677 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 15 client.4677 snapc 1=[] 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 put_snap_realm 0x1 0x7f00f0015cc0 2 -> 1 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 hrm is_target=1 is_dentry=0 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0015db0) - ctime 2024-03-23T23:58:13.743946+0000 mtime 2024-03-23T23:58:13.743946+0000 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 dir hash is 2 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 12 client.4677 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 4 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 12 client.4677 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=- has_dir_layout 0x7f00f0015db0) caps pAsLsXsFs 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 get_snap_realm 0x1 0x7f00f0015cc0, nref was 1 2024-03-23T23:58:13.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 get_snap_realm 0x1 0x7f00f0015cc0, nref now is 2 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 15 client.4677 add_update_cap first one, opened snaprealm 0x7f00f0015cc0 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015db0) 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 add_update_cap calling signal_caps_inode 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 10 client.4677 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015db0) 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 put_snap_realm 0x1 0x7f00f0015cc0 2 -> 1 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f0103400640 20 client.4677 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 lat 0.001306 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 _ll_get 0x7f00f0015db0 0x1 -> 1 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 2 client.4677 unmount 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 2 client.4677 unmounting 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a124c860 con 0x5611a1301d00 2024-03-23T23:58:13.778 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 10 client.4677 _ll_drop_pins 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 _ll_put 0x7f00f0015db0 0x1 1 -> 0 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 10 client.4677 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 10 client.4677 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 10 client.4677 nothing to flush 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 10 client.4677 flush_caps_sync 2024-03-23T23:58:13.779 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 10 client.4677 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 20 client.4677 trim_cache size 0 max 16384 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.769+0000 7f010c985480 10 client.4677 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 6 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.770+0000 7f010c985480 2 client.4677 cache still has 0+1 items, waiting (for caps to release?) 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.770+0000 7f0103400640 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.770+0000 7f0103400640 20 client.4677 put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 1 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.770+0000 7f0103400640 10 client.4677 unmounting: trim pass, size was 0+1 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.770+0000 7f0103400640 20 client.4677 trim_cache size 0 max 16384 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.770+0000 7f0103400640 10 client.4677 unmounting: trim pass, size still 0+1 2024-03-23T23:58:13.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:13.770+0000 7f010c985480 2 client.4677 cache still has 0+1 items, waiting (for caps to release?) 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 20 client.4677 tick 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 10 client.4677 renew_caps() 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 15 client.4677 renew_caps requesting from mds.0 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 10 client.4677 renew_caps mds.0 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 2) v7 -- 0x7f00d0000c00 con 0x5611a1301d00 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 20 client.4677 collect_and_send_metrics 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 20 client.4677 collect_and_send_global_metrics 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.001306, avg_latency: 0.001306, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 0 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 -- 0x7f00d0001490 con 0x5611a1301d00 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 10 client.4677 _put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) n = 2 2024-03-23T23:58:14.763 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 10 client.4677 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015db0) 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 15 client.4677 remove_cap last one, closing snaprealm 0x7f00f0015cc0 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 20 client.4677 put_snap_realm 0x1 0x7f00f0015cc0 1 -> 0 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 10 client.4677 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=- COMPLETE has_dir_layout 0x7f00f0015db0) 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 20 client.4677 trim_cache size 0 max 16384 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f00faa00640 20 client.4677 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f010c985480 2 client.4677 _close_mds_session mds.0 seq 0 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a12f6f20 con 0x5611a1301d00 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.762+0000 7f010c985480 2 client.4677 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.763+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(renewcaps seq 2) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a124c860 con 0x5611a1301d00 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.763+0000 7f0103400640 10 client.4677 handle_client_session client_session(renewcaps seq 2) v1 from mds.0 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.763+0000 7f0103400640 10 client.4677 unmounting: trim pass, size was 0+0 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.763+0000 7f0103400640 20 client.4677 trim_cache size 0 max 16384 2024-03-23T23:58:14.764 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.763+0000 7f0103400640 10 client.4677 unmounting: trim pass, size still 0+0 2024-03-23T23:58:14.768 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12f6f20 con 0x5611a1301d00 2024-03-23T23:58:14.768 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 10 client.4677 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:14.768 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 5 client.4677 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 1 -- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1301d00 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1301d00 0x5611a13a7dd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 10 client.4677 remove_session_caps mds.0 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 10 client.4677 kick_requests_closed for mds.0 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 10 client.4677 unmounting: trim pass, size was 0+0 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 20 client.4677 trim_cache size 0 max 16384 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f0103400640 10 client.4677 unmounting: trim pass, size still 0+0 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f010c985480 2 client.4677 unmounted. 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f010c985480 1 client.4677 shutdown 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 msgr2=0x5611a127df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.768+0000 7f010c985480 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0104003370 tx=0x7f00fc00bf90 comp rx=0 tx=0).stop 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 shutdown_connections 2024-03-23T23:58:14.769 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1301d00 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.770 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.770 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.770 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 --2- 172.21.15.31:0/3209603645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.770 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 >> 172.21.15.31:0/3209603645 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:14.771 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 shutdown_connections 2024-03-23T23:58:14.771 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 1 -- 172.21.15.31:0/3209603645 wait complete. 2024-03-23T23:58:14.771 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.769+0000 7f010c985480 20 client.4677 trim_cache size 0 max 16384 2024-03-23T23:58:14.771 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.770+0000 7f010c985480 1 -- start start 2024-03-23T23:58:14.771 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.771+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.771+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.771+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.771+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.771+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0007290 con 0x5611a12466d0 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.771+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13089b0 con 0x5611a1249e70 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.771+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a1308b60 con 0x5611a12fa280 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.772+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.772+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33444/0 (socket says 172.21.15.31:33444) 2024-03-23T23:58:14.772 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.772+0000 7f0109c00640 1 -- 172.21.15.31:0/3838342275 learned_addr learned my addr 172.21.15.31:0/3838342275 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:14.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.772+0000 7f0103e00640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.773 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.772+0000 7f010a600640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.773+0000 7f0109c00640 1 -- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.773+0000 7f0109c00640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.773+0000 7f0109c00640 1 -- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.773+0000 7f0109c00640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.773+0000 7f0109c00640 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1277660 con 0x5611a12466d0 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.773+0000 7f0109c00640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000fd0 tx=0x5611a1302360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2623d11cda5cb228 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.773+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0001490 con 0x5611a12466d0 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 10 client.4680 Subscribing to map 'mdsmap' 2024-03-23T23:58:14.775 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a1312d20 con 0x5611a12466d0 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00fc00b6c0 con 0x5611a12466d0 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f00fb400640 20 client.4680 tick 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f00fb400640 20 client.4680 collect_and_send_metrics 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f00fb400640 20 client.4680 collect_and_send_global_metrics 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f00fb400640 5 client.4680 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f00fb400640 20 client.4680 trim_cache size 0 max 16384 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f00fb400640 20 client.4680 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611a1174b70 con 0x5611a12466d0 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc04c040 con 0x5611a12466d0 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f0102000640 1 client.4680 handle_mds_map epoch 8 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 20 client.4680 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 10 client.4680 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 20 client.4680 mds is 0 2024-03-23T23:58:14.776 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 10 client.4680 _open_mds_session mds.0 2024-03-23T23:58:14.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a127df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a12325c0 con 0x5611a1247e20 2024-03-23T23:58:14.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.774+0000 7f010c985480 10 client.4680 waiting for session to mds.0 to open 2024-03-23T23:58:14.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.775+0000 7f0103e00640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a127df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.776+0000 7f0103e00640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a127df40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=320bfa8b18ac43d0 server_cookie=3c55f9396f63384f in_seq=0 out_seq=0 2024-03-23T23:58:14.777 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.776+0000 7f0102000640 10 client.4680 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:14.780 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a12325c0 con 0x5611a1247e20 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f0102000640 10 client.4680 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f0102000640 10 client.4680 renew_caps mds.0 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0015a20 con 0x5611a1247e20 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f0102000640 10 client.4680 connect_mds_targets for mds.0 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 10 client.4680 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 20 client.4680 mds is 0 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 10 client.4680 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 20 client.4680 encode_cap_releases enter (req: 0x5611a13a4680, mds: 0) 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 20 client.4680 send_request set sent_stamp to 2024-03-23T23:58:14.781927+0000 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 10 client.4680 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.775790+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.775790+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f6f20 con 0x5611a1247e20 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.780+0000 7f010c985480 20 client.4680 awaiting reply|forward|kick on 0x7ffef7334670 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.781+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0015a20 con 0x5611a1247e20 2024-03-23T23:58:14.781 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.781+0000 7f0102000640 10 client.4680 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f404ac50 con 0x5611a1247e20 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 insert_trace from 2024-03-23T23:58:14.781927+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 features 0xffffffffffffffff 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 update_snap_trace len 70 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref now is 1 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 15 client.4680 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 15 client.4680 snapc 1=[] 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.783 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 put_snap_realm 0x1 0x7f00f0015c40 2 -> 1 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 hrm is_target=1 is_dentry=0 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0015d30) - ctime 2024-03-23T23:58:13.743946+0000 mtime 2024-03-23T23:58:13.743946+0000 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 dir hash is 2 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 12 client.4680 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 4 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 12 client.4680 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=- has_dir_layout 0x7f00f0015d30) caps pAsLsXsFs 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref was 1 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref now is 2 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 15 client.4680 add_update_cap first one, opened snaprealm 0x7f00f0015c40 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 10 client.4680 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 put_snap_realm 0x1 0x7f00f0015c40 2 -> 1 2024-03-23T23:58:14.784 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 handle_client_reply signalling caller 0x7ffef7334670 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 lat 0.001464 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 _ll_get 0x7f00f0015d30 0x1 -> 1 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 8 client.4680 _ll_create 0x1.head test_llreadvllwritevopathfilehandlefile44572 0666 66, uid 0, gid 0 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 10 client.4680 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30) dn 'test_llreadvllwritevopathfilehandlefile44572' 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 10 client.4680 _getattr mask As issued=1 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 3 client.4680 may_create 0x7f00f0015d30 = 0 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 8 client.4680 _create(0x1 test_llreadvllwritevopathfilehandlefile44572, 0666) 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30) name test_llreadvllwritevopathfilehandlefile44572 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 15 open_dir 0x5611a1312e00 on 0x7f00f0015d30 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 15 client.4680 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30) 'test_llreadvllwritevopathfilehandlefile44572' dn 0x1.head["test_llreadvllwritevopathfilehandlefile44572"] (new dn) 2024-03-23T23:58:14.785 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 choose_target_mds inode dir hash is 2 on test_llreadvllwritevopathfilehandlefile44572 => 1792381274 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30) is_hash=1 hash=1792381274 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 10 client.4680 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 mds is 0 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 10 client.4680 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 encode_cap_releases enter (req: 0x5611a12f7250, mds: 0) 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 encode_dentry_release enter(dn:0x7f00f000c960) 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015d30), req:0x5611a12f7250 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 send_request set sent_stamp to 2024-03-23T23:58:14.783534+0000 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 10 client.4680 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevopathfilehandlefile44572 2024-03-23T23:58:14.783492+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevopathfilehandlefile44572 2024-03-23T23:58:14.783492+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f7ba0 con 0x5611a1247e20 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f010c985480 20 client.4680 awaiting reply|forward|kick on 0x7ffef73344b0 2024-03-23T23:58:14.786 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.787 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.782+0000 7f0102000640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.789 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 865+0+0 (crc 0 0 0) 0x7f00f40527e0 con 0x5611a1247e20 2024-03-23T23:58:14.789 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 insert_trace from 2024-03-23T23:58:14.783534+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 features 0xffffffffffffffff 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 update_snap_trace len 70 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref was 1 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref now is 2 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 hrm is_target=1 is_dentry=1 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) - ctime 2024-03-23T23:58:14.783492+0000 mtime 2024-03-23T23:58:14.783492+0000 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 12 client.4680 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 12 client.4680 add_update_inode adding 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref was 2 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref now is 3 2024-03-23T23:58:14.790 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 15 client.4680 add_update_cap first one, opened snaprealm 0x7f00f0015c40 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 12 client.4680 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015d30) caps pAsLsXsFs 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:13.743946+0000 ctime=2024-03-23T23:58:13.743946+0000 change_attr=4 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015d30) pAsLsXs ctime 2024-03-23T23:58:14.783492+0000 mtime 2024-03-23T23:58:14.783492+0000 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 dir hash is 2 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 12 client.4680 add_update_inode client inode change_attr: 4 , mds inodestat change_attr: 5 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 clearing (I_COMPLETE|I_DIR_ORDERED) on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 10 client.4680 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 12 client.4680 insert_dentry_inode 'test_llreadvllwritevopathfilehandlefile44572' vino 0x10000000002.head in dir 0x1.head dn 0x7f00f000c960 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 15 client.4680 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) 'test_llreadvllwritevopathfilehandlefile44572' to inode 0x7f00f0016310 dn 0x1.head["test_llreadvllwritevopathfilehandlefile44572"] (old dn) 2024-03-23T23:58:14.791 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 link inode 0x7f00f0016310 parents now 0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 15 client.4680 update_dentry_lease 0x1.head["test_llreadvllwritevopathfilehandlefile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:14.783534+0000 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 put_snap_realm 0x1 0x7f00f0015c40 3 -> 2 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 handle_client_reply signalling caller 0x7ffef73344b0 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 delegated_inos: [] 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 make_request created ino 0x10000000002 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 make_request target is 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 lat 0.007056 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000002.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.792 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 _create_fh 0x10000000002 mode 3 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 trim_cache size 1 max 16384 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 8 client.4680 create(#0x1/test_llreadvllwritevopathfilehandlefile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 _ll_create created = 1 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 8 client.4680 _ll_create 0x1.head test_llreadvllwritevopathfilehandlefile44572 0666 66 = 0 (0x5611a12f7fb0 10000000002) 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 _ll_get 0x7f00f0016310 0x10000000002 -> 1 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 fill_statx on 0x10000000002 snap/devhead mode 0100666 mtime 2024-03-23T23:58:14.783492+0000 ctime 2024-03-23T23:58:14.783492+0000 change_attr 0 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 3 client.4680 ll_release (fh)0x5611a12f7fb0 0x10000000002 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f0102000640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 8 client.4680 _release_fh 0x5611a12f7fb0 mode 3 on 0x10000000002.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 _flush 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.793 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 nothing to flush 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 check_caps on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 delaying cap release 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 cap_delay_requeue on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 _release_fh 0x5611a12f7fb0 on inode 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) no async_err state 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 3 client.4680 ll_unlink 0x1.head test_llreadvllwritevopathfilehandlefile44572 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30); ; name test_llreadvllwritevopathfilehandlefile44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 _getattr mask As issued=1 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 3 client.4680 may_delete 0x7f00f0015d30 = 0 2024-03-23T23:58:14.794 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 8 client.4680 _unlink(0x1 test_llreadvllwritevopathfilehandlefile44572 uid 0 gid 0) 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) name test_llreadvllwritevopathfilehandlefile44572 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 _lookup have 0x1.head["test_llreadvllwritevopathfilehandlefile44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) test_llreadvllwritevopathfilehandlefile44572 = 0x10000000002.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 choose_target_mds inode dir hash is 2 on test_llreadvllwritevopathfilehandlefile44572 => 1792381274 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30) is_hash=1 hash=1792381274 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 choose_target_mds from dirfragtree hash 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 mds is 0 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 encode_cap_releases enter (req: 0x5611a12f8140, mds: 0) 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 encode_inode_release enter(in:0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310), req:0x5611a12f8140 mds:0, drop:LsxXx, unless:-, force:0) 2024-03-23T23:58:14.795 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 encode_dentry_release enter(dn:0x7f00f000c960) 2024-03-23T23:58:14.796 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015d30), req:0x5611a12f8140 mds:0, drop:Fs, unless:Fx, force:1) 2024-03-23T23:58:14.796 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 send_request set sent_stamp to 2024-03-23T23:58:14.790911+0000 2024-03-23T23:58:14.796 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 10 client.4680 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevopathfilehandlefile44572 2024-03-23T23:58:14.790858+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.796 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevopathfilehandlefile44572 2024-03-23T23:58:14.790858+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f8470 con 0x5611a1247e20 2024-03-23T23:58:14.796 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.789+0000 7f010c985480 20 client.4680 awaiting reply|forward|kick on 0x7ffef7334690 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_caps(revoke ino 0x10000000002 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:14.783492+0000 ctime 2024-03-23T23:58:14.783492+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f4052b40 con 0x5611a1247e20 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 5 client.4680 set_cap_epoch_barrier epoch = 21 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 mds.0 seq now 1 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 5 client.4680 handle_cap_grant on in 0x10000000002 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsFsxcrwb 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) pAsxXsFsxcrwb ctime 2024-03-23T23:58:14.783492+0000 mtime 2024-03-23T23:58:14.783492+0000 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 revocation of Ax 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 check_caps on 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) wanted - used - issued pAsXsFsxcrwb revoking Ax flags=1 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsFsxcrwb revoking Ax 2024-03-23T23:58:14.797 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 completed revocation of Ax 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 send_cap 0x10000000002.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevopathfilehandlefile44572"] 0x7f00f0016310) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsFsxcrwb revoking Ax dropping Fxcrwb 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 15 client.4680 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000002 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:14.783492+0000 ctime 2024-03-23T23:58:14.783492+0000 change_attr 0) v12 -- 0x7f00f00168f0 con 0x5611a1247e20 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.791+0000 7f0102000640 10 client.4680 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_reply(???:3 = 0 (0) Success unsafe) v1 ==== 513+0+0 (crc 0 0 0) 0x7f00f40669b0 con 0x5611a1247e20 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 handle_client_reply got a reply. Safe:0 tid 3 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 insert_trace from 2024-03-23T23:58:14.790911+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 features 0xffffffffffffffff 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 update_snap_trace len 70 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref was 2 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 get_snap_realm 0x1 0x7f00f0015c40, nref now is 3 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 hrm is_target=0 is_dentry=1 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 12 client.4680 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) caps pAsLsXs 2024-03-23T23:58:14.798 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=5 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) pAsLsXs ctime 2024-03-23T23:58:14.790858+0000 mtime 2024-03-23T23:58:14.790858+0000 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 dir hash is 2 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 12 client.4680 add_update_inode client inode change_attr: 5 , mds inodestat change_attr: 6 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 15 client.4680 unlink dir 0x7f00f0015d30 'test_llreadvllwritevopathfilehandlefile44572' dn 0x7f00f000c960 inode 0x7f00f0016310 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 unlink inode 0x7f00f0016310 parents now 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 put_snap_realm 0x1 0x7f00f0015c40 3 -> 2 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 handle_client_reply signalling caller 0x7ffef7334690 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 20 client.4680 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 20 client.4680 lat 0.004667 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 20 client.4680 trim_cache size 1 max 16384 2024-03-23T23:58:14.799 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 8 client.4680 unlink(#0x1/test_llreadvllwritevopathfilehandlefile44572) = 0 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 2 client.4680 unmount 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 2 client.4680 unmounting 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a12f8470 con 0x5611a1247e20 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 10 client.4680 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 unmounting: trim pass, size was 1+2 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 20 client.4680 trim_cache size 1 max 16384 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f0102000640 10 client.4680 unmounting: trim pass, size still 1+2 2024-03-23T23:58:14.800 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.794+0000 7f010c985480 10 client.4680 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_caps(grant ino 0x10000000002 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:14.783492+0000 ctime 2024-03-23T23:58:14.790858+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f00168f0 con 0x5611a1247e20 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 mds.0 seq now 2 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 5 client.4680 handle_cap_grant on in 0x10000000002 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 update_inode_file_time 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.783492+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) pAsXsFs ctime 2024-03-23T23:58:14.790858+0000 mtime 2024-03-23T23:58:14.783492+0000 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 max_size 4194304 -> 0 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 grant, new caps are LsFxcrwb 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 5 client.4680 _try_to_trim_inode in 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) 2024-03-23T23:58:14.803 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 unmounting: trim pass, size was 1+2 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 20 client.4680 trim_cache size 1 max 16384 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 unmounting: trim pass, size still 1+2 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f4066d10 con 0x5611a1247e20 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 20 client.4680 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 insert_trace from 2024-03-23T23:58:14.790911+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 unmounting: trim pass, size was 1+2 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 20 client.4680 trim_cache size 1 max 16384 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 15 client.4680 trim_dentry unlinking dn test_llreadvllwritevopathfilehandlefile44572 in dir 0x1 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 15 client.4680 unlink dir 0x7f00f0015d30 'test_llreadvllwritevopathfilehandlefile44572' dn 0x7f00f000c960 inode 0 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 15 client.4680 unlink removing 'test_llreadvllwritevopathfilehandlefile44572' dn 0x7f00f000c960 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 15 client.4680 close_dir dir 0x5611a1312e00 on 0x7f00f0015d30 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.804 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f0102000640 10 client.4680 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 _ll_drop_pins 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 _ll_put 0x7f00f0016310 0x10000000002 1 -> 0 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 _ll_put 0x7f00f0015d30 0x1 2 -> 0 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 _release 0x10000000002.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 _invalidate_inode_cache 0x10000000002.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 _flush 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) 2024-03-23T23:58:14.805 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 nothing to flush 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 nothing to flush 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 1 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 1 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 flush_caps_sync 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 20 client.4680 trim_cache size 0 max 16384 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) n = 11 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.802+0000 7f010c985480 10 client.4680 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 15 client.4680 remove_cap last one, closing snaprealm 0x7f00f0015c40 2024-03-23T23:58:14.806 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 20 client.4680 put_snap_realm 0x1 0x7f00f0015c40 2 -> 1 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 10 client.4680 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=- has_dir_layout 0x7f00f0015d30) 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 10 client.4680 _put_inode on 0x10000000002.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) n = 15 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 10 client.4680 remove_cap mds.0 on 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 15 client.4680 remove_cap last one, closing snaprealm 0x7f00f0015c40 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 20 client.4680 put_snap_realm 0x1 0x7f00f0015c40 1 -> 0 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 10 client.4680 _put_inode deleting 0x10000000002.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.783492+0000 mtime=2024-03-23T23:58:14.783492+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=1 caps=- objectset[0x10000000002 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016310) 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 2 client.4680 _close_mds_session mds.0 seq 2 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 2) v7 -- 0x5611a12f8980 con 0x5611a1247e20 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f010c985480 2 client.4680 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_caps(grant ino 0x10000000002 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:14.783492+0000 ctime 2024-03-23T23:58:14.790858+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f40705b0 con 0x5611a1247e20 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 10 client.4680 mds.0 seq now 3 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 3) v7 -- 0x7f00f0015a20 con 0x5611a1247e20 2024-03-23T23:58:14.807 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 5 client.4680 handle_caps don't have vino 0x10000000002.head op 0, immediately releasing 2024-03-23T23:58:14.808 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_cap_release(3) v2 -- 0x5611a12f87d0 con 0x5611a1247e20 2024-03-23T23:58:14.808 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 10 client.4680 unmounting: trim pass, size was 0+0 2024-03-23T23:58:14.808 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 20 client.4680 trim_cache size 0 max 16384 2024-03-23T23:58:14.808 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.803+0000 7f0102000640 10 client.4680 unmounting: trim pass, size still 0+0 2024-03-23T23:58:14.809 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0015a20 con 0x5611a1247e20 2024-03-23T23:58:14.809 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 10 client.4680 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:14.809 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 5 client.4680 _closed_mds_session mds.0 seq 3 2024-03-23T23:58:14.809 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 1 -- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 msgr2=0x5611a127df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.809 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a127df40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.809 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 10 client.4680 remove_session_caps mds.0 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 10 client.4680 kick_requests_closed for mds.0 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 10 client.4680 unmounting: trim pass, size was 0+0 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 20 client.4680 trim_cache size 0 max 16384 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f0102000640 10 client.4680 unmounting: trim pass, size still 0+0 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f010c985480 2 client.4680 unmounted. 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f010c985480 1 client.4680 shutdown 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 msgr2=0x5611a13a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.808+0000 7f010c985480 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000fd0 tx=0x5611a1302360 comp rx=0 tx=0).stop 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 shutdown_connections 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a127df40 unknown :-1 s=CLOSED pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 --2- 172.21.15.31:0/3838342275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.810 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 >> 172.21.15.31:0/3838342275 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:14.811 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 shutdown_connections 2024-03-23T23:58:14.811 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 1 -- 172.21.15.31:0/3838342275 wait complete. 2024-03-23T23:58:14.811 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.809+0000 7f010c985480 20 client.4680 trim_cache size 0 max 16384 2024-03-23T23:58:14.811 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritevOPathFileHandle (1051 ms) 2024-03-23T23:58:14.811 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritevReadOnlyFile 2024-03-23T23:58:14.812 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.810+0000 7f010c985480 1 -- start start 2024-03-23T23:58:14.812 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.811+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:14.812 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.811+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.812 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.811+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.811+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.811+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0008790 con 0x5611a1249e70 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.811+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13b27c0 con 0x5611a1247e20 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.811+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a1234de0 con 0x5611a12466d0 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.812+0000 7f0103e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.812+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.812+0000 7f0103e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:56120/0 (socket says 172.21.15.31:56120) 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.812+0000 7f0103e00640 1 -- 172.21.15.31:0/2377166864 learned_addr learned my addr 172.21.15.31:0/2377166864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.812+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010a600640 1 -- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 msgr2=0x5611a13a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010a600640 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010a600640 1 -- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010a600640 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.813 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010a600640 1 -- 172.21.15.31:0/2377166864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a124cd30 con 0x5611a1249e70 2024-03-23T23:58:14.815 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010a600640 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0104025000 tx=0x7f010401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea57808a8415ca0c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:14.815 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:14.815 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104029050 con 0x5611a1249e70 2024-03-23T23:58:14.815 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104017640 con 0x5611a1249e70 2024-03-23T23:58:14.815 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010c985480 10 client.4683 Subscribing to map 'mdsmap' 2024-03-23T23:58:14.815 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.813+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a13b1920 con 0x5611a1249e70 2024-03-23T23:58:14.815 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f00faa00640 20 client.4683 tick 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f00faa00640 20 client.4683 collect_and_send_metrics 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f00faa00640 20 client.4683 collect_and_send_global_metrics 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f00faa00640 5 client.4683 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f00faa00640 20 client.4683 trim_cache size 0 max 16384 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f00faa00640 20 client.4683 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040020b0 con 0x5611a1249e70 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a1249e70 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f0103400640 1 client.4683 handle_mds_map epoch 8 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f010c985480 20 client.4683 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f010c985480 10 client.4683 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f010c985480 20 client.4683 mds is 0 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f010c985480 10 client.4683 _open_mds_session mds.0 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f010c985480 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a1309110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.816 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1277440 con 0x5611a12fa280 2024-03-23T23:58:14.817 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.814+0000 7f010c985480 10 client.4683 waiting for session to mds.0 to open 2024-03-23T23:58:14.817 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.815+0000 7f0109c00640 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a1309110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.817 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.815+0000 7f0109c00640 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a1309110 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5195ea154c5ccbb server_cookie=6ebc1fe346b45c18 in_seq=0 out_seq=0 2024-03-23T23:58:14.817 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.816+0000 7f0103400640 10 client.4683 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1277440 con 0x5611a12fa280 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f0103400640 10 client.4683 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f0103400640 10 client.4683 renew_caps mds.0 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0006190 con 0x5611a12fa280 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f0103400640 10 client.4683 connect_mds_targets for mds.0 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 10 client.4683 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 20 client.4683 mds is 0 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 10 client.4683 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 20 client.4683 encode_cap_releases enter (req: 0x5611a13130d0, mds: 0) 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 20 client.4683 send_request set sent_stamp to 2024-03-23T23:58:14.821143+0000 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 10 client.4683 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.815410+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.820 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.815410+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1278810 con 0x5611a12fa280 2024-03-23T23:58:14.821 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f010c985480 20 client.4683 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:14.821 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0000c00 con 0x5611a12fa280 2024-03-23T23:58:14.821 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.820+0000 7f0103400640 10 client.4683 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc03d040 con 0x5611a12fa280 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 insert_trace from 2024-03-23T23:58:14.821143+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 features 0xffffffffffffffff 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 update_snap_trace len 70 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 get_snap_realm 0x1 0x7f00f0015d30, nref now is 1 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:14.822 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 15 client.4683 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 15 client.4683 snapc 1=[] 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 put_snap_realm 0x1 0x7f00f0015d30 2 -> 1 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 hrm is_target=1 is_dentry=0 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0015e20) - ctime 2024-03-23T23:58:14.790858+0000 mtime 2024-03-23T23:58:14.790858+0000 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 dir hash is 2 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 12 client.4683 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 12 client.4683 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=- has_dir_layout 0x7f00f0015e20) caps pAsLsXsFs 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 get_snap_realm 0x1 0x7f00f0015d30, nref was 1 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 get_snap_realm 0x1 0x7f00f0015d30, nref now is 2 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 15 client.4683 add_update_cap first one, opened snaprealm 0x7f00f0015d30 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015e20) 2024-03-23T23:58:14.823 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0015e20) 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 put_snap_realm 0x1 0x7f00f0015d30 2 -> 1 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 lat 0.001373 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 _ll_get 0x7f00f0015e20 0x1 -> 1 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 2 client.4683 unmount 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 unmounting: trim pass, size was 0+1 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 20 client.4683 trim_cache size 0 max 16384 2024-03-23T23:58:14.824 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f0103400640 10 client.4683 unmounting: trim pass, size still 0+1 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 2 client.4683 unmounting 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 _ll_drop_pins 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 _ll_put 0x7f00f0015e20 0x1 1 -> 0 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 nothing to flush 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.825 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 1 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 flush_caps_sync 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 trim_cache size 0 max 16384 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) n = 8 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0015e20) 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 15 client.4683 remove_cap last one, closing snaprealm 0x7f00f0015d30 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 20 client.4683 put_snap_realm 0x1 0x7f00f0015d30 1 -> 0 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 10 client.4683 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=- COMPLETE has_dir_layout 0x7f00f0015e20) 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 2 client.4683 _close_mds_session mds.0 seq 0 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a12769e0 con 0x5611a12fa280 2024-03-23T23:58:14.826 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.821+0000 7f010c985480 2 client.4683 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:14.828 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12769e0 con 0x5611a12fa280 2024-03-23T23:58:14.828 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 10 client.4683 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:14.828 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 5 client.4683 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:14.828 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 1 -- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 msgr2=0x5611a1309110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.828 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a1309110 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.828 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 10 client.4683 remove_session_caps mds.0 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 10 client.4683 kick_requests_closed for mds.0 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 10 client.4683 unmounting: trim pass, size was 0+0 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 20 client.4683 trim_cache size 0 max 16384 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f0103400640 10 client.4683 unmounting: trim pass, size still 0+0 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f010c985480 2 client.4683 unmounted. 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.827+0000 7f010c985480 1 client.4683 shutdown 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0104025000 tx=0x7f010401b000 comp rx=0 tx=0).stop 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 shutdown_connections 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a1309110 unknown :-1 s=CLOSED pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.829 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 --2- 172.21.15.31:0/2377166864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.830 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 >> 172.21.15.31:0/2377166864 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:14.830 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 shutdown_connections 2024-03-23T23:58:14.830 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 1 -- 172.21.15.31:0/2377166864 wait complete. 2024-03-23T23:58:14.830 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.828+0000 7f010c985480 20 client.4683 trim_cache size 0 max 16384 2024-03-23T23:58:14.830 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.829+0000 7f010c985480 1 -- start start 2024-03-23T23:58:14.830 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.831+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:14.832 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.831+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.831+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.831+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000c3d0 con 0x5611a1249e70 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1301a30 con 0x5611a1247e20 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a12f4b50 con 0x5611a12466d0 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33464/0 (socket says 172.21.15.31:33464) 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010a600640 1 -- 172.21.15.31:0/1825354458 learned_addr learned my addr 172.21.15.31:0/1825354458 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f0103e00640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f0109c00640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.833 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010a600640 1 -- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 msgr2=0x5611a13a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.834 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010a600640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.834 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010a600640 1 -- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.834 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.832+0000 7f010a600640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.834 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f010a600640 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13089b0 con 0x5611a1249e70 2024-03-23T23:58:14.834 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f0103e00640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:14.834 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f010a600640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0104005e60 tx=0x7f0104006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e86c140a7da3be2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:14.835 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f010c985480 10 client.4686 Subscribing to map 'mdsmap' 2024-03-23T23:58:14.835 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a13020f0 con 0x5611a1249e70 2024-03-23T23:58:14.835 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104053060 con 0x5611a1249e70 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104024b50 con 0x5611a1249e70 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f00fb400640 20 client.4686 tick 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f00fb400640 20 client.4686 collect_and_send_metrics 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f00fb400640 20 client.4686 collect_and_send_global_metrics 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f00fb400640 5 client.4686 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f00fb400640 20 client.4686 trim_cache size 0 max 16384 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.833+0000 7f00fb400640 20 client.4686 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a1249e70 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f0102000640 1 client.4686 handle_mds_map epoch 8 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f010c985480 20 client.4686 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f010c985480 10 client.4686 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f010c985480 20 client.4686 mds is 0 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f010c985480 10 client.4686 _open_mds_session mds.0 2024-03-23T23:58:14.836 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f010c985480 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a127df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.837 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127ea90 con 0x5611a12fa280 2024-03-23T23:58:14.837 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f010c985480 10 client.4686 waiting for session to mds.0 to open 2024-03-23T23:58:14.837 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.834+0000 7f0109c00640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a127df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.837 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.835+0000 7f0109c00640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a127df40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0ad2bc5ef785fc6 server_cookie=645a90815a217778 in_seq=0 out_seq=0 2024-03-23T23:58:14.837 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.835+0000 7f0102000640 10 client.4686 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127ea90 con 0x5611a12fa280 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f0102000640 10 client.4686 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f0102000640 10 client.4686 renew_caps mds.0 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0015d30 con 0x5611a12fa280 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f0102000640 10 client.4686 connect_mds_targets for mds.0 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 10 client.4686 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 20 client.4686 mds is 0 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 10 client.4686 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:14.842 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 20 client.4686 encode_cap_releases enter (req: 0x5611a13130d0, mds: 0) 2024-03-23T23:58:14.843 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 20 client.4686 send_request set sent_stamp to 2024-03-23T23:58:14.843238+0000 2024-03-23T23:58:14.843 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 10 client.4686 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.835243+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.843 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.835243+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f77e0 con 0x5611a12fa280 2024-03-23T23:58:14.843 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f010c985480 20 client.4686 awaiting reply|forward|kick on 0x7ffef7334670 2024-03-23T23:58:14.843 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0015d30 con 0x5611a12fa280 2024-03-23T23:58:14.843 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.842+0000 7f0102000640 10 client.4686 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc03d040 con 0x5611a12fa280 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 insert_trace from 2024-03-23T23:58:14.843238+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 features 0xffffffffffffffff 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 update_snap_trace len 70 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref now is 1 2024-03-23T23:58:14.845 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 15 client.4686 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 15 client.4686 snapc 1=[] 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 put_snap_realm 0x1 0x7f00f0015f50 2 -> 1 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 hrm is_target=1 is_dentry=0 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0016040) - ctime 2024-03-23T23:58:14.790858+0000 mtime 2024-03-23T23:58:14.790858+0000 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 dir hash is 2 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 6 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 12 client.4686 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=- has_dir_layout 0x7f00f0016040) caps pAsLsXsFs 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref was 1 2024-03-23T23:58:14.846 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref now is 2 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 15 client.4686 add_update_cap first one, opened snaprealm 0x7f00f0015f50 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 10 client.4686 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 put_snap_realm 0x1 0x7f00f0015f50 2 -> 1 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 handle_client_reply signalling caller 0x7ffef7334670 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 lat 0.001253 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 _ll_get 0x7f00f0016040 0x1 -> 1 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.847 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f0102000640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 8 client.4686 _ll_create 0x1.head test_llreadvllwritevreadonlyfile44572 0666 576, uid 0, gid 0 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 10 client.4686 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) dn 'test_llreadvllwritevreadonlyfile44572' 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 10 client.4686 _getattr mask As issued=1 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 3 client.4686 may_create 0x7f00f0016040 = 0 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 8 client.4686 _create(0x1 test_llreadvllwritevreadonlyfile44572, 0666) 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) name test_llreadvllwritevreadonlyfile44572 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 15 open_dir 0x5611a13b2830 on 0x7f00f0016040 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 15 client.4686 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) 'test_llreadvllwritevreadonlyfile44572' dn 0x1.head["test_llreadvllwritevreadonlyfile44572"] (new dn) 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 choose_target_mds inode dir hash is 2 on test_llreadvllwritevreadonlyfile44572 => 562940448 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) is_hash=1 hash=562940448 2024-03-23T23:58:14.848 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 10 client.4686 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 mds is 0 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 10 client.4686 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 encode_cap_releases enter (req: 0x5611a12f77e0, mds: 0) 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 encode_dentry_release enter(dn:0x7f00f0015c40) 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016040), req:0x5611a12f77e0 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 send_request set sent_stamp to 2024-03-23T23:58:14.844779+0000 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 10 client.4686 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile44572 2024-03-23T23:58:14.844680+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevreadonlyfile44572 2024-03-23T23:58:14.844680+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12761d0 con 0x5611a12fa280 2024-03-23T23:58:14.849 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.843+0000 7f010c985480 20 client.4686 awaiting reply|forward|kick on 0x7ffef73344b0 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 858+0+0 (crc 0 0 0) 0x7f00d0001630 con 0x5611a12fa280 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 insert_trace from 2024-03-23T23:58:14.844779+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 features 0xffffffffffffffff 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 update_snap_trace len 70 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref was 1 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref now is 2 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 hrm is_target=1 is_dentry=1 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) - ctime 2024-03-23T23:58:14.844680+0000 mtime 2024-03-23T23:58:14.844680+0000 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 12 client.4686 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:14.852 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 12 client.4686 add_update_inode adding 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) caps pAsxLsXsxFscr 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref was 2 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref now is 3 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 15 client.4686 add_update_cap first one, opened snaprealm 0x7f00f0015f50 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 add_update_cap issued - -> pAsxLsXsxFscr from mds.0 on 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 12 client.4686 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016040) caps pAsLsXsFs 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.790858+0000 ctime=2024-03-23T23:58:14.790858+0000 change_attr=6 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016040) pAsLsXs ctime 2024-03-23T23:58:14.844680+0000 mtime 2024-03-23T23:58:14.844680+0000 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 dir hash is 2 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 12 client.4686 add_update_inode client inode change_attr: 6 , mds inodestat change_attr: 7 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 clearing (I_COMPLETE|I_DIR_ORDERED) on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 10 client.4686 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:14.853 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 12 client.4686 insert_dentry_inode 'test_llreadvllwritevreadonlyfile44572' vino 0x10000000003.head in dir 0x1.head dn 0x7f00f0015c40 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 15 client.4686 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) 'test_llreadvllwritevreadonlyfile44572' to inode 0x7f00f0016620 dn 0x1.head["test_llreadvllwritevreadonlyfile44572"] (old dn) 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 link inode 0x7f00f0016620 parents now 0x1.head["test_llreadvllwritevreadonlyfile44572"] 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 15 client.4686 update_dentry_lease 0x1.head["test_llreadvllwritevreadonlyfile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:14.844779+0000 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 put_snap_realm 0x1 0x7f00f0015f50 3 -> 2 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 handle_client_reply signalling caller 0x7ffef73344b0 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f0102000640 20 client.4686 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 10 client.4686 delegated_inos: [] 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 10 client.4686 make_request created ino 0x10000000003 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 make_request target is 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.854 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 lat 0.006988 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000003.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 10 client.4686 _create_fh 0x10000000003 mode 1 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 trim_cache size 1 max 16384 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 8 client.4686 create(#0x1/test_llreadvllwritevreadonlyfile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 _ll_create created = 1 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 8 client.4686 _ll_create 0x1.head test_llreadvllwritevreadonlyfile44572 0666 576 = 0 (0x5611a1276590 10000000003) 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 _ll_get 0x7f00f0016620 0x10000000003 -> 1 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 10 client.4686 fill_statx on 0x10000000003 snap/devhead mode 0100666 mtime 2024-03-23T23:58:14.844680+0000 ctime 2024-03-23T23:58:14.844680+0000 change_attr 0 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.850+0000 7f010c985480 3 client.4686 pwritev(0x5611a1276590, "...", 14, 0) = -9 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.851+0000 7f010c985480 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127d270 0x5611a127d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.855 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.851+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:1 3.32 3:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x5611a12f51e0 con 0x5611a127d270 2024-03-23T23:58:14.856 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.851+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:2 3.32 3:4def72d4:::10000000003.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x5611a12f5a50 con 0x5611a127d270 2024-03-23T23:58:14.856 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.851+0000 7f0102000640 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.856 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.851+0000 7f0102000640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.856 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.851+0000 7f0103e00640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127d270 0x5611a127d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.856 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.852+0000 7f0103e00640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127d270 0x5611a127d6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=5ce71c919e6e5e19 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:14.856 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.852+0000 7f0102000640 10 client.4686 ms_handle_connect on v2:172.21.15.31:6809/2134439972 2024-03-23T23:58:14.858 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.852+0000 7f0103e00640 1 -- 172.21.15.31:0/1825354458 <== osd.0 v2:172.21.15.31:6809/2134439972 1 ==== osd_op_reply(1 10000000003.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a127d270 2024-03-23T23:58:14.858 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f0103e00640 1 -- 172.21.15.31:0/1825354458 <== osd.0 v2:172.21.15.31:6809/2134439972 2 ==== osd_op_reply(2 10000000003.00000000 [create] v23'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a127d270 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 get_caps 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) have pAsxLsXsxFscr need Fr want Fc revoking - 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 _read_async 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=1} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 0~14 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 3 client.4686 preadv(0x5611a1276590, 0) = 0 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 3 client.4686 ll_release (fh)0x5611a1276590 0x10000000003 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 8 client.4686 _release_fh 0x5611a1276590 mode 1 on 0x10000000003.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=0} open={1=1} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 _flush 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 nothing to flush 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 check_caps on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) wanted - used - issued pAsxLsXsxFscr revoking - flags=0 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 cap mds.0 issued pAsxLsXsxFscr implemented pAsxLsXsxFscr revoking - 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 delaying cap release 2024-03-23T23:58:14.859 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 cap_delay_requeue on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 _release_fh 0x5611a1276590 on inode 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) no async_err state 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 3 client.4686 ll_unlink 0x1.head test_llreadvllwritevreadonlyfile44572 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 may_delete 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040); ; name test_llreadvllwritevreadonlyfile44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 _getattr mask As issued=1 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 3 client.4686 may_delete 0x7f00f0016040 = 0 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 8 client.4686 _unlink(0x1 test_llreadvllwritevreadonlyfile44572 uid 0 gid 0) 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) name test_llreadvllwritevreadonlyfile44572 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 _lookup have 0x1.head["test_llreadvllwritevreadonlyfile44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 _lookup 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) test_llreadvllwritevreadonlyfile44572 = 0x10000000003.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.860 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 choose_target_mds inode dir hash is 2 on test_llreadvllwritevreadonlyfile44572 => 562940448 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040) is_hash=1 hash=562940448 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 choose_target_mds from dirfragtree hash 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 mds is 0 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 encode_cap_releases enter (req: 0x5611a12761d0, mds: 0) 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 encode_inode_release enter(in:0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxLsXsxFscr(0=pAsxLsXsxFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620), req:0x5611a12761d0 mds:0, drop:LsxXx, unless:-, force:0) 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 encode_dentry_release enter(dn:0x7f00f0015c40) 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016040), req:0x5611a12761d0 mds:0, drop:Fs, unless:Fx, force:1) 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 send_request set sent_stamp to 2024-03-23T23:58:14.857386+0000 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 10 client.4686 send_request client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevreadonlyfile44572 2024-03-23T23:58:14.857326+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.861 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 unlink #0x1/test_llreadvllwritevreadonlyfile44572 2024-03-23T23:58:14.857326+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f5ec0 con 0x5611a12fa280 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.856+0000 7f010c985480 20 client.4686 awaiting reply|forward|kick on 0x7ffef7334690 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_caps(revoke ino 0x10000000003 1 seq 2 caps=pAsXsFscr dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:14.844680+0000 ctime 2024-03-23T23:58:14.844680+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a060 con 0x5611a12fa280 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 5 client.4686 set_cap_epoch_barrier epoch = 21 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 mds.0 seq now 1 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 5 client.4686 handle_cap_grant on in 0x10000000003 mds.0 seq 2 caps now pAsXsFscr was pAsxXsFscr 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsxXsFscr(0=pAsxXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) pAsxXsFscr ctime 2024-03-23T23:58:14.844680+0000 mtime 2024-03-23T23:58:14.844680+0000 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 revocation of Ax 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 check_caps on 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) wanted - used - issued pAsXsFscr revoking Ax flags=1 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 cap mds.0 issued pAsXsFscr implemented pAsxXsFscr revoking Ax 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 completed revocation of Ax 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 send_cap 0x10000000003.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevreadonlyfile44572"] 0x7f00f0016620) mds.0 seq 2 used - want - flush - retain pAsLsXsFscr held pAsxXsFscr revoking Ax dropping - 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 15 client.4686 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:14.862 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000003 1 seq 2 caps=pAsXsFscr dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:14.844680+0000 ctime 2024-03-23T23:58:14.844680+0000 change_attr 0) v12 -- 0x7f00f0016c00 con 0x5611a12fa280 2024-03-23T23:58:14.863 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.857+0000 7f0102000640 10 client.4686 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_reply(???:3 = 0 (0) Success unsafe) v1 ==== 506+0+0 (crc 0 0 0) 0x7f00d8003440 con 0x5611a12fa280 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 handle_client_reply got a reply. Safe:0 tid 3 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 insert_trace from 2024-03-23T23:58:14.857386+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 features 0xffffffffffffffff 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 update_snap_trace len 70 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref was 2 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 get_snap_realm 0x1 0x7f00f0015f50, nref now is 3 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 hrm is_target=0 is_dentry=1 2024-03-23T23:58:14.864 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 12 client.4686 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) caps pAsLsXs 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=7 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) pAsLsXs ctime 2024-03-23T23:58:14.857326+0000 mtime 2024-03-23T23:58:14.857326+0000 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 dir hash is 2 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 12 client.4686 add_update_inode client inode change_attr: 7 , mds inodestat change_attr: 8 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 15 client.4686 unlink dir 0x7f00f0016040 'test_llreadvllwritevreadonlyfile44572' dn 0x7f00f0015c40 inode 0x7f00f0016620 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 unlink inode 0x7f00f0016620 parents now 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 put_snap_realm 0x1 0x7f00f0015f50 3 -> 2 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 handle_client_reply signalling caller 0x7ffef7334690 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 20 client.4686 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:14.865 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 20 client.4686 lat 0.004331 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 20 client.4686 trim_cache size 1 max 16384 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 8 client.4686 unlink(#0x1/test_llreadvllwritevreadonlyfile44572) = 0 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 2 client.4686 unmount 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 2 client.4686 unmounting 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a12f5ec0 con 0x5611a12fa280 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 10 client.4686 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 unmounting: trim pass, size was 1+2 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 20 client.4686 trim_cache size 1 max 16384 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f0102000640 10 client.4686 unmounting: trim pass, size still 1+2 2024-03-23T23:58:14.866 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.860+0000 7f010c985480 10 client.4686 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_caps(grant ino 0x10000000003 1 seq 3 caps=pAsLsXsFscr dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:14.844680+0000 ctime 2024-03-23T23:58:14.857326+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f0016c00 con 0x5611a12fa280 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 10 client.4686 mds.0 seq now 2 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 5 client.4686 handle_cap_grant on in 0x10000000003 mds.0 seq 3 caps now pAsLsXsFscr was pAsXsFscr 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 10 client.4686 update_inode_file_time 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.844680+0000 change_attr=0 caps=pAsXsFscr(0=pAsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) pAsXsFscr ctime 2024-03-23T23:58:14.857326+0000 mtime 2024-03-23T23:58:14.844680+0000 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 10 client.4686 grant, new caps are Ls 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 10 client.4686 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 5 client.4686 _try_to_trim_inode in 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) 2024-03-23T23:58:14.868 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 10 client.4686 unmounting: trim pass, size was 1+2 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 20 client.4686 trim_cache size 1 max 16384 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 10 client.4686 unmounting: trim pass, size still 1+2 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.866+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc023950 con 0x5611a12fa280 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 20 client.4686 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 10 client.4686 insert_trace from 2024-03-23T23:58:14.857386+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 10 client.4686 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 10 client.4686 unmounting: trim pass, size was 1+2 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 20 client.4686 trim_cache size 1 max 16384 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 15 client.4686 trim_dentry unlinking dn test_llreadvllwritevreadonlyfile44572 in dir 0x1 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 15 client.4686 unlink dir 0x7f00f0016040 'test_llreadvllwritevreadonlyfile44572' dn 0x7f00f0015c40 inode 0 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 15 client.4686 unlink removing 'test_llreadvllwritevreadonlyfile44572' dn 0x7f00f0015c40 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 15 client.4686 close_dir dir 0x5611a13b2830 on 0x7f00f0016040 2024-03-23T23:58:14.869 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f0102000640 10 client.4686 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _ll_drop_pins 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 _ll_put 0x7f00f0016620 0x10000000003 1 -> 0 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 _ll_put 0x7f00f0016040 0x1 2 -> 0 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 _release 0x10000000003.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _invalidate_inode_cache 0x10000000003.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) 2024-03-23T23:58:14.870 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _flush 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 nothing to flush 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 _release 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _flush 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 nothing to flush 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 1 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 1 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 flush_caps_sync 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 trim_cache size 0 max 16384 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) n = 11 2024-03-23T23:58:14.871 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 15 client.4686 remove_cap last one, closing snaprealm 0x7f00f0015f50 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_snap_realm 0x1 0x7f00f0015f50 2 -> 1 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=- has_dir_layout 0x7f00f0016040) 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _put_inode on 0x10000000003.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) n = 15 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 remove_cap mds.0 on 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=pAsLsXsFscr(0=pAsLsXsFscr) objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 15 client.4686 remove_cap last one, closing snaprealm 0x7f00f0015f50 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 20 client.4686 put_snap_realm 0x1 0x7f00f0015f50 1 -> 0 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 10 client.4686 _put_inode deleting 0x10000000003.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={1=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:14.844680+0000 mtime=2024-03-23T23:58:14.844680+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=1 caps=- objectset[0x10000000003 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016620) 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 2 client.4686 _close_mds_session mds.0 seq 2 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 2) v7 -- 0x5611a12f57e0 con 0x5611a12fa280 2024-03-23T23:58:14.872 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.867+0000 7f010c985480 2 client.4686 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:14.873 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12f57e0 con 0x5611a12fa280 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 10 client.4686 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 5 client.4686 _closed_mds_session mds.0 seq 2 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 1 -- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 msgr2=0x5611a127df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a127df40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 10 client.4686 remove_session_caps mds.0 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 10 client.4686 kick_requests_closed for mds.0 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 10 client.4686 unmounting: trim pass, size was 0+0 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 20 client.4686 trim_cache size 0 max 16384 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f0102000640 10 client.4686 unmounting: trim pass, size still 0+0 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010c985480 2 client.4686 unmounted. 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010c985480 1 client.4686 shutdown 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127d270 msgr2=0x5611a127d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:14.874 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010c985480 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127d270 0x5611a127d6f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010c985480 1 --2- 172.21.15.31:0/1825354458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13a5470 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0104005e60 tx=0x7f0104006000 comp rx=0 tx=0).stop 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010a600640 1 -- 172.21.15.31:0/1825354458 reap_dead start 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.872+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 shutdown_connections 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.873+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 >> 172.21.15.31:0/1825354458 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.873+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 shutdown_connections 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.873+0000 7f010c985480 1 -- 172.21.15.31:0/1825354458 wait complete. 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.873+0000 7f010c985480 20 client.4686 trim_cache size 0 max 16384 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritevReadOnlyFile (64 ms) 2024-03-23T23:58:14.875 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritevIOClientNotMounted 2024-03-23T23:58:14.876 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.874+0000 7f010c985480 1 -- start start 2024-03-23T23:58:14.876 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.875+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:14.876 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.875+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.875+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.875+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0008450 con 0x5611a1249e70 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13b26f0 con 0x5611a12466d0 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13b1240 con 0x5611a12fa280 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:56130/0 (socket says 172.21.15.31:56130) 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f0109c00640 1 -- 172.21.15.31:0/486065953 learned_addr learned my addr 172.21.15.31:0/486065953 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33468/0 (socket says 172.21.15.31:33468) 2024-03-23T23:58:14.877 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.876+0000 7f0103e00640 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.877+0000 7f010a600640 1 -- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.877+0000 7f010a600640 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.877+0000 7f010a600640 1 -- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.877+0000 7f010a600640 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.877+0000 7f010a600640 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1232470 con 0x5611a1249e70 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.877+0000 7f010a600640 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5611a1301a00 tx=0x7f0104002040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a80151093e9037 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.877+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:14.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043070 con 0x5611a1249e70 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104024690 con 0x5611a1249e70 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f010c985480 10 client.4689 Subscribing to map 'mdsmap' 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a127b450 con 0x5611a1249e70 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f00faa00640 20 client.4689 tick 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f00faa00640 20 client.4689 collect_and_send_metrics 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f00faa00640 20 client.4689 collect_and_send_global_metrics 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f00faa00640 5 client.4689 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f00faa00640 20 client.4689 trim_cache size 0 max 16384 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f00faa00640 20 client.4689 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010403d470 con 0x5611a1249e70 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010403dbe0 con 0x5611a1249e70 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.878+0000 7f0103400640 1 client.4689 handle_mds_map epoch 8 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f010c985480 20 client.4689 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f010c985480 10 client.4689 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f010c985480 20 client.4689 mds is 0 2024-03-23T23:58:14.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f010c985480 10 client.4689 _open_mds_session mds.0 2024-03-23T23:58:14.881 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f010c985480 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:14.881 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127ea90 con 0x5611a1247e20 2024-03-23T23:58:14.881 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f010c985480 10 client.4689 waiting for session to mds.0 to open 2024-03-23T23:58:14.881 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.879+0000 7f0109c00640 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:14.881 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.881+0000 7f0109c00640 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a13130d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9c55f1b92bbcf2 server_cookie=53b146d6687f99f3 in_seq=0 out_seq=0 2024-03-23T23:58:14.881 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.881+0000 7f0103400640 10 client.4689 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:14.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127ea90 con 0x5611a1247e20 2024-03-23T23:58:14.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f0103400640 10 client.4689 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:14.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f0103400640 10 client.4689 renew_caps mds.0 2024-03-23T23:58:14.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0016040 con 0x5611a1247e20 2024-03-23T23:58:14.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f0103400640 10 client.4689 connect_mds_targets for mds.0 2024-03-23T23:58:14.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 10 client.4689 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:14.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 20 client.4689 mds is 0 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 10 client.4689 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 20 client.4689 encode_cap_releases enter (req: 0x5611a127ac90, mds: 0) 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 20 client.4689 send_request set sent_stamp to 2024-03-23T23:58:14.887395+0000 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 10 client.4689 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.880058+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:14.880058+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f4330 con 0x5611a1247e20 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f010c985480 20 client.4689 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0016040 con 0x5611a1247e20 2024-03-23T23:58:14.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.886+0000 7f0103400640 10 client.4689 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:14.888 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc03d040 con 0x5611a1247e20 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 insert_trace from 2024-03-23T23:58:14.887395+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 features 0xffffffffffffffff 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 update_snap_trace len 70 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 get_snap_realm 0x1 0x7f00f000cf40, nref now is 1 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 15 client.4689 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 15 client.4689 snapc 1=[] 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 put_snap_realm 0x1 0x7f00f000cf40 2 -> 1 2024-03-23T23:58:14.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 hrm is_target=1 is_dentry=0 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0016260) - ctime 2024-03-23T23:58:14.857326+0000 mtime 2024-03-23T23:58:14.857326+0000 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 dir hash is 2 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 12 client.4689 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 8 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 12 client.4689 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=- has_dir_layout 0x7f00f0016260) caps pAsLsXsFs 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 get_snap_realm 0x1 0x7f00f000cf40, nref was 1 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 get_snap_realm 0x1 0x7f00f000cf40, nref now is 2 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 15 client.4689 add_update_cap first one, opened snaprealm 0x7f00f000cf40 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016260) 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 add_update_cap calling signal_caps_inode 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 10 client.4689 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016260) 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 put_snap_realm 0x1 0x7f00f000cf40 2 -> 1 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:14.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f0103400640 20 client.4689 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 lat 0.001526 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 _ll_get 0x7f00f0016260 0x1 -> 1 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 2 client.4689 unmount 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 2 client.4689 unmounting 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a12f4330 con 0x5611a1247e20 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 10 client.4689 _ll_drop_pins 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 _ll_put 0x7f00f0016260 0x1 1 -> 0 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.891 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 20 client.4689 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.887+0000 7f010c985480 10 client.4689 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 10 client.4689 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 10 client.4689 nothing to flush 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 10 client.4689 flush_caps_sync 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 10 client.4689 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 20 client.4689 trim_cache size 0 max 16384 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 10 client.4689 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 6 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 2 client.4689 cache still has 0+1 items, waiting (for caps to release?) 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f0103400640 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f0103400640 20 client.4689 put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 1 2024-03-23T23:58:14.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f0103400640 10 client.4689 unmounting: trim pass, size was 0+1 2024-03-23T23:58:14.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f0103400640 20 client.4689 trim_cache size 0 max 16384 2024-03-23T23:58:14.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f0103400640 10 client.4689 unmounting: trim pass, size still 0+1 2024-03-23T23:58:14.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:14.888+0000 7f010c985480 2 client.4689 cache still has 0+1 items, waiting (for caps to release?) 2024-03-23T23:58:15.386 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:15.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 20 client.4689 tick 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 10 client.4689 renew_caps() 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 15 client.4689 renew_caps requesting from mds.0 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 10 client.4689 renew_caps mds.0 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 2) v7 -- 0x7f00d00018b0 con 0x5611a1247e20 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 20 client.4689 collect_and_send_metrics 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 20 client.4689 collect_and_send_global_metrics 2024-03-23T23:58:15.879 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_metrics [client_metric_type: READ_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: WRITE_LATENCY latency: 0.000000, avg_latency: 0.000000, sq_sum: 0, count=0][client_metric_type: METADATA_LATENCY latency: 0.001526, avg_latency: 0.001526, sq_sum: 0, count=1][client_metric_type: CAP_INFO cap_hits: 0 cap_misses: 0 num_caps: 0][client_metric_type: DENTRY_LEASE dlease_hits: 0 dlease_misses: 0 num_dentries: 0][client_metric_type: OPENED_FILES opened_files: 0 total_inodes: 1][client_metric_type: PINNED_ICAPS pinned_icaps: 1 total_inodes: 1][client_metric_type: OPENED_INODES opened_inodes: 0 total_inodes: 1][client_metric_type: READ_IO_SIZES total_ops: 0 total_size: 0][client_metric_type: WRITE_IO_SIZES total_ops: 0 total_size: 0] v1 -- 0x7f00d00010a0 con 0x5611a1247e20 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 10 client.4689 _put_inode on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) n = 2 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 10 client.4689 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016260) 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 15 client.4689 remove_cap last one, closing snaprealm 0x7f00f000cf40 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 20 client.4689 put_snap_realm 0x1 0x7f00f000cf40 1 -> 0 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 10 client.4689 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=- COMPLETE has_dir_layout 0x7f00f0016260) 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 20 client.4689 trim_cache size 0 max 16384 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f00faa00640 20 client.4689 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f010c985480 2 client.4689 _close_mds_session mds.0 seq 0 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a1276750 con 0x5611a1247e20 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f010c985480 2 client.4689 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(renewcaps seq 2) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d00018b0 con 0x5611a1247e20 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f0103400640 10 client.4689 handle_client_session client_session(renewcaps seq 2) v1 from mds.0 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f0103400640 10 client.4689 unmounting: trim pass, size was 0+0 2024-03-23T23:58:15.880 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f0103400640 20 client.4689 trim_cache size 0 max 16384 2024-03-23T23:58:15.881 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.879+0000 7f0103400640 10 client.4689 unmounting: trim pass, size still 0+0 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12f4330 con 0x5611a1247e20 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 10 client.4689 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 5 client.4689 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 1 -- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 msgr2=0x5611a13130d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a13130d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 10 client.4689 remove_session_caps mds.0 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 10 client.4689 kick_requests_closed for mds.0 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 10 client.4689 unmounting: trim pass, size was 0+0 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 20 client.4689 trim_cache size 0 max 16384 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f0103400640 10 client.4689 unmounting: trim pass, size still 0+0 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f010c985480 2 client.4689 unmounted. 2024-03-23T23:58:15.885 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f010c985480 1 client.4689 shutdown 2024-03-23T23:58:15.886 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 msgr2=0x5611a127df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.885+0000 7f010c985480 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x5611a1301a00 tx=0x7f0104002040 comp rx=0 tx=0).stop 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 shutdown_connections 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1247e20 0x5611a13130d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12fa280 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 --2- 172.21.15.31:0/486065953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 >> 172.21.15.31:0/486065953 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 shutdown_connections 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 1 -- 172.21.15.31:0/486065953 wait complete. 2024-03-23T23:58:15.887 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.886+0000 7f010c985480 20 client.4689 trim_cache size 0 max 16384 2024-03-23T23:58:15.888 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.887+0000 7f010c985480 1 -- start start 2024-03-23T23:58:15.888 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.888+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:15.888 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a127df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a12f4d10 con 0x5611a12466d0 2024-03-23T23:58:15.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1306620 con 0x5611a1249e70 2024-03-23T23:58:15.889 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a12f4330 con 0x5611a1247e20 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33474/0 (socket says 172.21.15.31:33474) 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f0109c00640 1 -- 172.21.15.31:0/1119229742 learned_addr learned my addr 172.21.15.31:0/1119229742 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f010a600640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.889+0000 7f0103e00640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a127df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0109c00640 1 -- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 msgr2=0x5611a127df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0109c00640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a127df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0109c00640 1 -- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0109c00640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.890 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0109c00640 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a12f77a0 con 0x5611a12466d0 2024-03-23T23:58:15.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0109c00640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000e70 tx=0x5611a13a8310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca323423a3349ca7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:15.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:15.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.890+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00010a0 con 0x5611a12466d0 2024-03-23T23:58:15.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00fc00fa80 con 0x5611a12466d0 2024-03-23T23:58:15.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 10 client.4692 Subscribing to map 'mdsmap' 2024-03-23T23:58:15.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a12781f0 con 0x5611a12466d0 2024-03-23T23:58:15.892 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f00fb400640 20 client.4692 tick 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f00fb400640 20 client.4692 collect_and_send_metrics 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f00fb400640 20 client.4692 collect_and_send_global_metrics 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f00fb400640 5 client.4692 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f00fb400640 20 client.4692 trim_cache size 0 max 16384 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f00fb400640 20 client.4692 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f404ae50 con 0x5611a12466d0 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc00fcc0 con 0x5611a12466d0 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f0102000640 1 client.4692 handle_mds_map epoch 8 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 20 client.4692 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 10 client.4692 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 20 client.4692 mds is 0 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 10 client.4692 _open_mds_session mds.0 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.893 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13b1150 con 0x5611a12fa280 2024-03-23T23:58:15.894 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.891+0000 7f010c985480 10 client.4692 waiting for session to mds.0 to open 2024-03-23T23:58:15.894 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.892+0000 7f0103e00640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.894 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.893+0000 7f0103e00640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56536efb25e9e4b3 server_cookie=77b1ecea25ac3e4f in_seq=0 out_seq=0 2024-03-23T23:58:15.894 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.893+0000 7f0102000640 10 client.4692 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:15.897 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a13b1150 con 0x5611a12fa280 2024-03-23T23:58:15.897 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f0102000640 10 client.4692 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:15.897 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f0102000640 10 client.4692 renew_caps mds.0 2024-03-23T23:58:15.897 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0016040 con 0x5611a12fa280 2024-03-23T23:58:15.897 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f0102000640 10 client.4692 connect_mds_targets for mds.0 2024-03-23T23:58:15.897 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 10 client.4692 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 20 client.4692 mds is 0 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 10 client.4692 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 20 client.4692 encode_cap_releases enter (req: 0x5611a127b510, mds: 0) 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 20 client.4692 send_request set sent_stamp to 2024-03-23T23:58:15.898642+0000 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 10 client.4692 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.892580+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.892580+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a2c10 con 0x5611a12fa280 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.897+0000 7f010c985480 20 client.4692 awaiting reply|forward|kick on 0x7ffef7334670 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.898+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0016040 con 0x5611a12fa280 2024-03-23T23:58:15.898 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.898+0000 7f0102000640 10 client.4692 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:15.899 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f400a120 con 0x5611a12fa280 2024-03-23T23:58:15.899 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:15.899 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 insert_trace from 2024-03-23T23:58:15.898642+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 features 0xffffffffffffffff 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 update_snap_trace len 70 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0x7f00f0016260, nref now is 1 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 15 client.4692 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 15 client.4692 snapc 1=[] 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 put_snap_realm 0x1 0x7f00f0016260 2 -> 1 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 hrm is_target=1 is_dentry=0 2024-03-23T23:58:15.900 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0016350) - ctime 2024-03-23T23:58:14.857326+0000 mtime 2024-03-23T23:58:14.857326+0000 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 dir hash is 2 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 12 client.4692 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 8 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 12 client.4692 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=- has_dir_layout 0x7f00f0016350) caps pAsLsXsFs 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0x7f00f0016260, nref was 1 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0x7f00f0016260, nref now is 2 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 15 client.4692 add_update_cap first one, opened snaprealm 0x7f00f0016260 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 10 client.4692 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 put_snap_realm 0x1 0x7f00f0016260 2 -> 1 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 handle_client_reply signalling caller 0x7ffef7334670 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:15.901 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 lat 0.001513 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 _ll_get 0x7f00f0016350 0x1 -> 1 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 8 client.4692 _ll_create 0x1.head test_llreadvllwritevioclientnotmountedfile44572 0666 578, uid 0, gid 0 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 10 client.4692 _lookup concluded ENOENT locally for 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350) dn 'test_llreadvllwritevioclientnotmountedfile44572' 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 may_create 0x1.head(faked_ino=0 nref=6 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 10 client.4692 _getattr mask As issued=1 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 3 client.4692 may_create 0x7f00f0016350 = 0 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 8 client.4692 _create(0x1 test_llreadvllwritevioclientnotmountedfile44572, 0666) 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 get_or_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350) name test_llreadvllwritevioclientnotmountedfile44572 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 15 open_dir 0x5611a12f4d10 on 0x7f00f0016350 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 15 client.4692 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350) 'test_llreadvllwritevioclientnotmountedfile44572' dn 0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] (new dn) 2024-03-23T23:58:15.902 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 choose_target_mds inode dir hash is 2 on test_llreadvllwritevioclientnotmountedfile44572 => 1555592945 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350) is_hash=1 hash=1555592945 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 10 client.4692 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 mds is 0 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 10 client.4692 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 encode_cap_releases enter (req: 0x5611a13a2c10, mds: 0) 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 encode_dentry_release enter(dn:0x7f00f0015f50) 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE has_dir_layout 0x7f00f0016350), req:0x5611a13a2c10 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 send_request set sent_stamp to 2024-03-23T23:58:15.900261+0000 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 10 client.4692 send_request client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevioclientnotmountedfile44572 2024-03-23T23:58:15.900226+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevioclientnotmountedfile44572 2024-03-23T23:58:15.900226+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276110 con 0x5611a12fa280 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f010c985480 20 client.4692 awaiting reply|forward|kick on 0x7ffef73344b0 2024-03-23T23:58:15.903 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.904 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.899+0000 7f0102000640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 868+0+0 (crc 0 0 0) 0x7f00f4066950 con 0x5611a12fa280 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 insert_trace from 2024-03-23T23:58:15.900261+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 features 0xffffffffffffffff 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 update_snap_trace len 70 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0x7f00f0016260, nref was 1 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0x7f00f0016260, nref now is 2 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 hrm is_target=1 is_dentry=1 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 update_inode_file_time 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) - ctime 2024-03-23T23:58:15.900226+0000 mtime 2024-03-23T23:58:15.900226+0000 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 12 client.4692 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:15.910 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 12 client.4692 add_update_inode adding 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=- objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0x7f00f0016260, nref was 2 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 get_snap_realm 0x1 0x7f00f0016260, nref now is 3 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 15 client.4692 add_update_cap first one, opened snaprealm 0x7f00f0016260 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 12 client.4692 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016350) caps pAsLsXsFs 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 update_inode_file_time 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:14.857326+0000 ctime=2024-03-23T23:58:14.857326+0000 change_attr=8 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016350) pAsLsXs ctime 2024-03-23T23:58:15.900226+0000 mtime 2024-03-23T23:58:15.900226+0000 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 dir hash is 2 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 12 client.4692 add_update_inode client inode change_attr: 8 , mds inodestat change_attr: 9 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 clearing (I_COMPLETE|I_DIR_ORDERED) on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) COMPLETE has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.911 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 12 client.4692 insert_dentry_inode 'test_llreadvllwritevioclientnotmountedfile44572' vino 0x10000000004.head in dir 0x1.head dn 0x7f00f0015f50 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 15 client.4692 link dir 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 'test_llreadvllwritevioclientnotmountedfile44572' to inode 0x7f00f0016930 dn 0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] (old dn) 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 link inode 0x7f00f0016930 parents now 0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 15 client.4692 update_dentry_lease 0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:15.900261+0000 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_snap_realm 0x1 0x7f00f0016260 3 -> 2 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 handle_client_reply signalling caller 0x7ffef73344b0 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 delegated_inos: [] 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 make_request created ino 0x10000000004 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 make_request target is 0x10000000004.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.912 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 lat 0.007174 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000004.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000004.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 _create_fh 0x10000000004 mode 3 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 trim_cache size 1 max 16384 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 8 client.4692 create(#0x1/test_llreadvllwritevioclientnotmountedfile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 _ll_create created = 1 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 8 client.4692 _ll_create 0x1.head test_llreadvllwritevioclientnotmountedfile44572 0666 578 = 0 (0x5611a13a3130 10000000004) 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 _ll_get 0x7f00f0016930 0x10000000004 -> 1 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 fill_statx on 0x10000000004 snap/devhead mode 0100666 mtime 2024-03-23T23:58:15.900226+0000 ctime 2024-03-23T23:58:15.900226+0000 change_attr 0 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 3 client.4692 ll_release (fh)0x5611a13a3130 0x10000000004 2024-03-23T23:58:15.913 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 8 client.4692 _release_fh 0x5611a13a3130 mode 3 on 0x10000000004.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 _flush 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 nothing to flush 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 check_caps on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 delaying cap release 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 cap_delay_requeue on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 _release_fh 0x5611a13a3130 on inode 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) no async_err state 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 2 client.4692 unmount 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 2 client.4692 unmounting 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a1276110 con 0x5611a12fa280 2024-03-23T23:58:15.914 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 waiting for write request '2' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevioclientnotmountedfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 unmounting: trim pass, size was 1+2 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 trim_cache size 1 max 16384 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 15 client.4692 trim_dentry unlinking dn test_llreadvllwritevioclientnotmountedfile44572 in dir 0x1 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 15 client.4692 unlink dir 0x7f00f0016350 'test_llreadvllwritevioclientnotmountedfile44572' dn 0x7f00f0015f50 inode 0x7f00f0016930 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 unlink inode 0x7f00f0016930 parents now 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 15 client.4692 unlink removing 'test_llreadvllwritevioclientnotmountedfile44572' dn 0x7f00f0015f50 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 15 client.4692 close_dir dir 0x5611a12f4d10 on 0x7f00f0016350 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f0102000640 10 client.4692 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:15.915 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 10 client.4692 _ll_drop_pins 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 _ll_put 0x7f00f0016930 0x10000000004 1 -> 0 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 _ll_put 0x7f00f0016350 0x1 2 -> 0 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.906+0000 7f010c985480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 _release 0x10000000004.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _invalidate_inode_cache 0x10000000004.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _flush 0x10000000004.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 nothing to flush 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.916 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 _release 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _flush 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 nothing to flush 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_inode on 0x10000000004.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 flush_caps_sync 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 trim_cache size 0 max 16384 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 10 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 15 client.4692 remove_cap last one, closing snaprealm 0x7f00f0016260 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_snap_realm 0x1 0x7f00f0016260 2 -> 1 2024-03-23T23:58:15.917 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=- has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _put_inode on 0x10000000004.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 13 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 remove_cap mds.0 on 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 15 client.4692 remove_cap last one, closing snaprealm 0x7f00f0016260 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 20 client.4692 put_snap_realm 0x1 0x7f00f0016260 1 -> 0 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 10 client.4692 _put_inode deleting 0x10000000004.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.900226+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=0 caps=- objectset[0x10000000004 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 2 client.4692 _close_mds_session mds.0 seq 0 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a1276520 con 0x5611a12fa280 2024-03-23T23:58:15.918 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.907+0000 7f010c985480 2 client.4692 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:15.919 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1276520 con 0x5611a12fa280 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 10 client.4692 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 5 client.4692 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 1 -- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 msgr2=0x5611a13130d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 10 client.4692 remove_session_caps mds.0 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 10 client.4692 kick_requests_closed for mds.0 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 10 client.4692 unmounting: trim pass, size was 0+0 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 20 client.4692 trim_cache size 0 max 16384 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f0102000640 10 client.4692 unmounting: trim pass, size still 0+0 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f010c985480 2 client.4692 unmounted. 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.912+0000 7f010c985480 1 client.4692 shutdown 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 msgr2=0x5611a13a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:15.920 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000e70 tx=0x5611a13a8310 comp rx=0 tx=0).stop 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 shutdown_connections 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a127df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 --2- 172.21.15.31:0/1119229742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 >> 172.21.15.31:0/1119229742 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 shutdown_connections 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 1 -- 172.21.15.31:0/1119229742 wait complete. 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.913+0000 7f010c985480 20 client.4692 trim_cache size 0 max 16384 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritevIOClientNotMounted (1041 ms) 2024-03-23T23:58:15.921 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritevNegativeIOVCount 2024-03-23T23:58:15.924 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.915+0000 7f010c985480 1 -- start start 2024-03-23T23:58:15.924 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.916+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:15.924 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.924 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.924 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.924 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0003e80 con 0x5611a1247e20 2024-03-23T23:58:15.924 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a92d0 con 0x5611a1249e70 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13b11d0 con 0x5611a12466d0 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33484/0 (socket says 172.21.15.31:33484) 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.917+0000 7f0103e00640 1 -- 172.21.15.31:0/1333981863 learned_addr learned my addr 172.21.15.31:0/1333981863 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.918+0000 7f010a600640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.918+0000 7f0109c00640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.918+0000 7f0103e00640 1 -- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.918+0000 7f0103e00640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.918+0000 7f0103e00640 1 -- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 msgr2=0x5611a127df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.918+0000 7f0103e00640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.918+0000 7f0103e00640 1 -- 172.21.15.31:0/1333981863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1246da0 con 0x5611a1247e20 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f0103e00640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a13a5470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00f4005b00 tx=0x7f00f404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968707611bd12afc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:15.925 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f010c985480 10 client.4695 Subscribing to map 'mdsmap' 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a13b1920 con 0x5611a1247e20 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f00faa00640 20 client.4695 tick 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f00faa00640 20 client.4695 collect_and_send_metrics 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f00faa00640 20 client.4695 collect_and_send_global_metrics 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f00faa00640 5 client.4695 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f00faa00640 20 client.4695 trim_cache size 0 max 16384 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f00faa00640 20 client.4695 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4057040 con 0x5611a1247e20 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00f40527e0 con 0x5611a1247e20 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00f4017bc0 con 0x5611a1247e20 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.919+0000 7f0103400640 1 client.4695 handle_mds_map epoch 8 2024-03-23T23:58:15.926 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f010c985480 20 client.4695 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f010c985480 10 client.4695 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f010c985480 20 client.4695 mds is 0 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f010c985480 10 client.4695 _open_mds_session mds.0 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f010c985480 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13a81d0 con 0x5611a12fa280 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f010c985480 10 client.4695 waiting for session to mds.0 to open 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.920+0000 7f0109c00640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.921+0000 7f0109c00640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=145a15cafb318435 server_cookie=d8dd44936a10bc13 in_seq=0 out_seq=0 2024-03-23T23:58:15.927 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.921+0000 7f0103400640 10 client.4695 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a13a81d0 con 0x5611a12fa280 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f0103400640 10 client.4695 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f0103400640 10 client.4695 renew_caps mds.0 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f0007020 con 0x5611a12fa280 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f0103400640 10 client.4695 connect_mds_targets for mds.0 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 10 client.4695 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 20 client.4695 mds is 0 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 10 client.4695 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:15.930 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 20 client.4695 encode_cap_releases enter (req: 0x5611a13a7dd0, mds: 0) 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 20 client.4695 send_request set sent_stamp to 2024-03-23T23:58:15.927277+0000 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 10 client.4695 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.921031+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.921031+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12765e0 con 0x5611a12fa280 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f010c985480 20 client.4695 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f0007020 con 0x5611a12fa280 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.926+0000 7f0103400640 10 client.4695 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc03d070 con 0x5611a12fa280 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 insert_trace from 2024-03-23T23:58:15.927277+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 features 0xffffffffffffffff 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 update_snap_trace len 70 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:15.931 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 get_snap_realm 0x1 0x7f00f0007240, nref now is 1 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 15 client.4695 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 15 client.4695 snapc 1=[] 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 put_snap_realm 0x1 0x7f00f0007240 2 -> 1 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 hrm is_target=1 is_dentry=0 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0016350) - ctime 2024-03-23T23:58:15.900226+0000 mtime 2024-03-23T23:58:15.900226+0000 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 dir hash is 2 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 12 client.4695 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 9 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 12 client.4695 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=- has_dir_layout 0x7f00f0016350) caps pAsLsXsFs 2024-03-23T23:58:15.932 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 get_snap_realm 0x1 0x7f00f0007240, nref was 1 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 get_snap_realm 0x1 0x7f00f0007240, nref now is 2 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 15 client.4695 add_update_cap first one, opened snaprealm 0x7f00f0007240 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 put_snap_realm 0x1 0x7f00f0007240 2 -> 1 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 lat 0.001245 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 _ll_get 0x7f00f0016350 0x1 -> 1 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 2 client.4695 unmount 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.933 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 unmounting: trim pass, size was 0+1 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 20 client.4695 trim_cache size 0 max 16384 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f0103400640 10 client.4695 unmounting: trim pass, size still 0+1 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 2 client.4695 unmounting 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 _ll_drop_pins 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 _ll_put 0x7f00f0016350 0x1 1 -> 0 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.934 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 nothing to flush 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 flush_caps_sync 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 trim_cache size 0 max 16384 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 8 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 15 client.4695 remove_cap last one, closing snaprealm 0x7f00f0007240 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 20 client.4695 put_snap_realm 0x1 0x7f00f0007240 1 -> 0 2024-03-23T23:58:15.935 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 10 client.4695 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=- has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.936 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 2 client.4695 _close_mds_session mds.0 seq 0 2024-03-23T23:58:15.936 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a1276930 con 0x5611a12fa280 2024-03-23T23:58:15.936 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.927+0000 7f010c985480 2 client.4695 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:15.939 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1276930 con 0x5611a12fa280 2024-03-23T23:58:15.939 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 10 client.4695 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:15.939 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 5 client.4695 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:15.939 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 1 -- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 msgr2=0x5611a13130d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.939 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.939 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 10 client.4695 remove_session_caps mds.0 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 10 client.4695 kick_requests_closed for mds.0 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 10 client.4695 unmounting: trim pass, size was 0+0 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 20 client.4695 trim_cache size 0 max 16384 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f0103400640 10 client.4695 unmounting: trim pass, size still 0+0 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 2 client.4695 unmounted. 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 client.4695 shutdown 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a13a5470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00f4005b00 tx=0x7f00f404e000 comp rx=0 tx=0).stop 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 shutdown_connections 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13130d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.940 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a127df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 --2- 172.21.15.31:0/1333981863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.932+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 >> 172.21.15.31:0/1333981863 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.933+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 shutdown_connections 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.933+0000 7f010c985480 1 -- 172.21.15.31:0/1333981863 wait complete. 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.933+0000 7f010c985480 20 client.4695 trim_cache size 0 max 16384 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.934+0000 7f010c985480 1 -- start start 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.934+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.935+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.935+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.935+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.935+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0015ee0 con 0x5611a1249e70 2024-03-23T23:58:15.941 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.935+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1245cb0 con 0x5611a12466d0 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.935+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a1279650 con 0x5611a1247e20 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.935+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33486/0 (socket says 172.21.15.31:33486) 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f010a600640 1 -- 172.21.15.31:0/3394691519 learned_addr learned my addr 172.21.15.31:0/3394691519 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f0103e00640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f0109c00640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f010a600640 1 -- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f010a600640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f010a600640 1 -- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.942 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f010a600640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.936+0000 7f010a600640 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a20d0 con 0x5611a1249e70 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010a600640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0104034040 tx=0x7f0104040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328e4e10ef15fb12 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043070 con 0x5611a1249e70 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104017a00 con 0x5611a1249e70 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 10 client.4698 Subscribing to map 'mdsmap' 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a1306620 con 0x5611a1249e70 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f00fb400640 20 client.4698 tick 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f00fb400640 20 client.4698 collect_and_send_metrics 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f00fb400640 20 client.4698 collect_and_send_global_metrics 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f00fb400640 5 client.4698 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f00fb400640 20 client.4698 trim_cache size 0 max 16384 2024-03-23T23:58:15.943 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f00fb400640 20 client.4698 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104005ac0 con 0x5611a1249e70 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a1249e70 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f0102000640 1 client.4698 handle_mds_map epoch 8 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 20 client.4698 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 10 client.4698 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 20 client.4698 mds is 0 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 10 client.4698 _open_mds_session mds.0 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13a2ef0 con 0x5611a12fa280 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.937+0000 7f010c985480 10 client.4698 waiting for session to mds.0 to open 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.938+0000 7f0109c00640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.944 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.939+0000 7f0109c00640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=262a1dc1956748e1 server_cookie=1a863fe85d82cf91 in_seq=0 out_seq=0 2024-03-23T23:58:15.945 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.939+0000 7f0102000640 10 client.4698 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:15.946 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a13a2ef0 con 0x5611a12fa280 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f0102000640 10 client.4698 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f0102000640 10 client.4698 renew_caps mds.0 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00f00070f0 con 0x5611a12fa280 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f0102000640 10 client.4698 connect_mds_targets for mds.0 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f010c985480 10 client.4698 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f010c985480 20 client.4698 mds is 0 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f010c985480 10 client.4698 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f010c985480 20 client.4698 encode_cap_releases enter (req: 0x5611a13a3f70, mds: 0) 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f010c985480 20 client.4698 send_request set sent_stamp to 2024-03-23T23:58:15.944972+0000 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f010c985480 10 client.4698 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.938937+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.947 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.943+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.938937+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127a960 con 0x5611a12fa280 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f010c985480 20 client.4698 awaiting reply|forward|kick on 0x7ffef7334660 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00f00070f0 con 0x5611a12fa280 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00d0001240 con 0x5611a12fa280 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 insert_trace from 2024-03-23T23:58:15.944972+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 features 0xffffffffffffffff 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 update_snap_trace len 70 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref now is 1 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.948 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 15 client.4698 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 15 client.4698 snapc 1=[] 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 put_snap_realm 0x1 0x7f00f0007310 2 -> 1 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 hrm is_target=1 is_dentry=0 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00f0016350) - ctime 2024-03-23T23:58:15.900226+0000 mtime 2024-03-23T23:58:15.900226+0000 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 dir hash is 2 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 12 client.4698 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 9 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 12 client.4698 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=- has_dir_layout 0x7f00f0016350) caps pAsLsXsFs 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref was 1 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref now is 2 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 15 client.4698 add_update_cap first one, opened snaprealm 0x7f00f0007310 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 10 client.4698 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 put_snap_realm 0x1 0x7f00f0007310 2 -> 1 2024-03-23T23:58:15.949 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.944+0000 7f0102000640 20 client.4698 handle_client_reply signalling caller 0x7ffef7334660 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 20 client.4698 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 lat 0.001064 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 _ll_get 0x7f00f0016350 0x1 -> 1 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 8 client.4698 _ll_create 0x1.head test_llreadvllwritevnegativeiovcountfile44572 0666 578, uid 0, gid 0 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 _do_lookup on #0x1/test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnegativeiovcountfile44572 => 2345758681 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 choose_target_mds 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) is_hash=1 hash=2345758681 2024-03-23T23:58:15.950 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 mds is 0 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 encode_cap_releases enter (req: 0x5611a127a960, mds: 0) 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 send_request set sent_stamp to 2024-03-23T23:58:15.946102+0000 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 send_request client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.946079+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.946079+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127cd60 con 0x5611a12fa280 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 awaiting reply|forward|kick on 0x7ffef7334410 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc00f800 con 0x5611a12fa280 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 10 client.4698 insert_trace from 2024-03-23T23:58:15.946102+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 10 client.4698 insert_trace -- no trace 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 20 client.4698 handle_client_reply signalling caller 0x7ffef7334410 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 20 client.4698 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:15.951 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 lat 0.000624 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 _do_lookup res is -2 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 _lookup 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) test_llreadvllwritevnegativeiovcountfile44572 = -2 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 may_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 _getattr mask As issued=1 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 3 client.4698 may_create 0x7f00f0016350 = 0 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 8 client.4698 _create(0x1 test_llreadvllwritevnegativeiovcountfile44572, 0666) 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) name test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 15 open_dir 0x5611a13a4310 on 0x7f00f0016350 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 15 client.4698 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 'test_llreadvllwritevnegativeiovcountfile44572' dn 0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] (new dn) 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnegativeiovcountfile44572 => 2345758681 2024-03-23T23:58:15.952 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) is_hash=1 hash=2345758681 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 mds is 0 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 encode_cap_releases enter (req: 0x5611a127cd60, mds: 0) 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 encode_dentry_release enter(dn:0x7f00f0016260) 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350), req:0x5611a127cd60 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 send_request set sent_stamp to 2024-03-23T23:58:15.946781+0000 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 10 client.4698 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.946761+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.946761+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127d110 con 0x5611a12fa280 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f010c985480 20 client.4698 awaiting reply|forward|kick on 0x7ffef73344a0 2024-03-23T23:58:15.953 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.945+0000 7f0102000640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.955 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 866+0+0 (crc 0 0 0) 0x7f00fc00f9f0 con 0x5611a12fa280 2024-03-23T23:58:15.955 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:15.955 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 insert_trace from 2024-03-23T23:58:15.946781+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 features 0xffffffffffffffff 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 update_snap_trace len 70 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref was 1 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref now is 2 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 hrm is_target=1 is_dentry=1 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 update_inode_file_time 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) - ctime 2024-03-23T23:58:15.946761+0000 mtime 2024-03-23T23:58:15.946761+0000 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 12 client.4698 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 12 client.4698 add_update_inode adding 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=- objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref was 2 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref now is 3 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 15 client.4698 add_update_cap first one, opened snaprealm 0x7f00f0007310 2024-03-23T23:58:15.956 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 12 client.4698 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) caps pAsLsXsFs 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.900226+0000 ctime=2024-03-23T23:58:15.900226+0000 change_attr=9 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) pAsLsXs ctime 2024-03-23T23:58:15.946761+0000 mtime 2024-03-23T23:58:15.946761+0000 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 dir hash is 2 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 12 client.4698 add_update_inode client inode change_attr: 9 , mds inodestat change_attr: 10 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 10 client.4698 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 12 client.4698 insert_dentry_inode 'test_llreadvllwritevnegativeiovcountfile44572' vino 0x10000000005.head in dir 0x1.head dn 0x7f00f0016260 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 15 client.4698 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 'test_llreadvllwritevnegativeiovcountfile44572' to inode 0x7f00f0016930 dn 0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] (old dn) 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 link inode 0x7f00f0016930 parents now 0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 2024-03-23T23:58:15.957 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 15 client.4698 update_dentry_lease 0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:15.946781+0000 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 put_snap_realm 0x1 0x7f00f0007310 3 -> 2 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 handle_client_reply signalling caller 0x7ffef73344a0 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 delegated_inos: [] 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 make_request created ino 0x10000000005 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 make_request target is 0x10000000005.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 lat 0.006580 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000005.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.958 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000005.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 _create_fh 0x10000000005 mode 3 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 trim_cache size 1 max 16384 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 8 client.4698 create(#0x1/test_llreadvllwritevnegativeiovcountfile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 _ll_create created = 1 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 8 client.4698 _ll_create 0x1.head test_llreadvllwritevnegativeiovcountfile44572 0666 578 = 0 (0x5611a127add0 10000000005) 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 _ll_get 0x7f00f0016930 0x10000000005 -> 1 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 fill_statx on 0x10000000005 snap/devhead mode 0100666 mtime 2024-03-23T23:58:15.946761+0000 ctime 2024-03-23T23:58:15.946761+0000 change_attr 0 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 3 client.4698 ll_release (fh)0x5611a127add0 0x10000000005 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 8 client.4698 _release_fh 0x5611a127add0 mode 3 on 0x10000000005.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 _flush 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 nothing to flush 2024-03-23T23:58:15.959 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 check_caps on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 delaying cap release 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 cap_delay_requeue on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 _release_fh 0x5611a127add0 on inode 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) no async_err state 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 3 client.4698 ll_unlink 0x1.head test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 may_delete 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350); ; name test_llreadvllwritevnegativeiovcountfile44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 _getattr mask As issued=1 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 3 client.4698 may_delete 0x7f00f0016350 = 0 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 8 client.4698 _unlink(0x1 test_llreadvllwritevnegativeiovcountfile44572 uid 0 gid 0) 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 get_or_create 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) name test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.960 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 _lookup have 0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) test_llreadvllwritevnegativeiovcountfile44572 = 0x10000000005.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 choose_target_mds inode dir hash is 2 on test_llreadvllwritevnegativeiovcountfile44572 => 2345758681 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 choose_target_mds 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350) is_hash=1 hash=2345758681 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 choose_target_mds from dirfragtree hash 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 mds is 0 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 encode_cap_releases enter (req: 0x5611a127d110, mds: 0) 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 encode_inode_release enter(in:0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930), req:0x5611a127d110 mds:0, drop:LsxXx, unless:-, force:0) 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 encode_dentry_release enter(dn:0x7f00f0016260) 2024-03-23T23:58:15.961 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00f0016350), req:0x5611a127d110 mds:0, drop:Fs, unless:Fx, force:1) 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 send_request set sent_stamp to 2024-03-23T23:58:15.953524+0000 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 10 client.4698 send_request client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.953499+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevnegativeiovcountfile44572 2024-03-23T23:58:15.953499+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127d4f0 con 0x5611a12fa280 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f010c985480 20 client.4698 awaiting reply|forward|kick on 0x7ffef7334680 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.952+0000 7f0102000640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(revoke ino 0x10000000005 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:15.946761+0000 ctime 2024-03-23T23:58:15.946761+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a12fa280 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 5 client.4698 set_cap_epoch_barrier epoch = 21 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 mds.0 seq now 1 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 5 client.4698 handle_cap_grant on in 0x10000000005 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsFsxcrwb 2024-03-23T23:58:15.962 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 update_inode_file_time 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) pAsxXsFsxcrwb ctime 2024-03-23T23:58:15.946761+0000 mtime 2024-03-23T23:58:15.946761+0000 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 revocation of Ax 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 check_caps on 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) wanted - used - issued pAsXsFsxcrwb revoking Ax flags=1 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsFsxcrwb revoking Ax 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 completed revocation of Ax 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 send_cap 0x10000000005.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevnegativeiovcountfile44572"] 0x7f00f0016930) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsFsxcrwb revoking Ax dropping Fxcrwb 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 15 client.4698 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000005 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:15.946761+0000 ctime 2024-03-23T23:58:15.946761+0000 change_attr 0) v12 -- 0x7f00f0016f10 con 0x5611a12fa280 2024-03-23T23:58:15.963 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.953+0000 7f0102000640 10 client.4698 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:15.965 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:4 = 0 (0) Success unsafe) v1 ==== 514+0+0 (crc 0 0 0) 0x7f00fc00fbe0 con 0x5611a12fa280 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 20 client.4698 handle_client_reply got a reply. Safe:0 tid 4 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 10 client.4698 insert_trace from 2024-03-23T23:58:15.953524+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 10 client.4698 features 0xffffffffffffffff 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 10 client.4698 update_snap_trace len 70 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref was 2 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 20 client.4698 get_snap_realm 0x1 0x7f00f0007310, nref now is 3 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.956+0000 7f0102000640 10 client.4698 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 10 client.4698 hrm is_target=0 is_dentry=1 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 12 client.4698 add_update_inode had 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) caps pAsLsXs 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 10 client.4698 update_inode_file_time 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=10 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) pAsLsXs ctime 2024-03-23T23:58:15.953499+0000 mtime 2024-03-23T23:58:15.953499+0000 2024-03-23T23:58:15.966 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 dir hash is 2 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 12 client.4698 add_update_inode client inode change_attr: 10 , mds inodestat change_attr: 11 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 10 client.4698 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 15 client.4698 unlink dir 0x7f00f0016350 'test_llreadvllwritevnegativeiovcountfile44572' dn 0x7f00f0016260 inode 0x7f00f0016930 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 unlink inode 0x7f00f0016930 parents now 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 put_snap_realm 0x1 0x7f00f0007310 3 -> 2 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 handle_client_reply signalling caller 0x7ffef7334680 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 handle_client_reply awaiting kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 20 client.4698 sendrecv kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 20 client.4698 lat 0.004641 2024-03-23T23:58:15.967 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 20 client.4698 trim_cache size 1 max 16384 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 8 client.4698 unlink(#0x1/test_llreadvllwritevnegativeiovcountfile44572) = 0 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 2 client.4698 unmount 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 2 client.4698 unmounting 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a127d4f0 con 0x5611a12fa280 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 10 client.4698 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 10 client.4698 unmounting: trim pass, size was 1+2 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 20 client.4698 trim_cache size 1 max 16384 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f0102000640 10 client.4698 unmounting: trim pass, size still 1+2 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.957+0000 7f010c985480 10 client.4698 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_caps(grant ino 0x10000000005 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:15.946761+0000 ctime 2024-03-23T23:58:15.953499+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f0016f10 con 0x5611a12fa280 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 mds.0 seq now 2 2024-03-23T23:58:15.968 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 5 client.4698 handle_cap_grant on in 0x10000000005 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 update_inode_file_time 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.946761+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) pAsXsFs ctime 2024-03-23T23:58:15.953499+0000 mtime 2024-03-23T23:58:15.946761+0000 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 max_size 4194304 -> 0 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 grant, new caps are LsFxcrwb 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 5 client.4698 _try_to_trim_inode in 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 unmounting: trim pass, size was 1+2 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 20 client.4698 trim_cache size 1 max 16384 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 unmounting: trim pass, size still 1+2 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:4 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc023430 con 0x5611a12fa280 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 20 client.4698 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 insert_trace from 2024-03-23T23:58:15.953524+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 10 client.4698 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:15.969 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.964+0000 7f0102000640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 10 client.4698 unmounting: trim pass, size was 1+2 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 20 client.4698 trim_cache size 1 max 16384 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 15 client.4698 trim_dentry unlinking dn test_llreadvllwritevnegativeiovcountfile44572 in dir 0x1 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 15 client.4698 unlink dir 0x7f00f0016350 'test_llreadvllwritevnegativeiovcountfile44572' dn 0x7f00f0016260 inode 0 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 15 client.4698 unlink removing 'test_llreadvllwritevnegativeiovcountfile44572' dn 0x7f00f0016260 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 15 client.4698 close_dir dir 0x5611a13a4310 on 0x7f00f0016350 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 10 client.4698 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _ll_drop_pins 2024-03-23T23:58:15.970 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 _ll_put 0x7f00f0016930 0x10000000005 1 -> 0 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 _ll_put 0x7f00f0016350 0x1 2 -> 0 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 _release 0x10000000005.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _invalidate_inode_cache 0x10000000005.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _flush 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 nothing to flush 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 _release 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.971 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _flush 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 nothing to flush 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 1 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 1 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 flush_caps_sync 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 trim_cache size 0 max 16384 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) n = 12 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 15 client.4698 remove_cap last one, closing snaprealm 0x7f00f0007310 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_snap_realm 0x1 0x7f00f0007310 2 -> 1 2024-03-23T23:58:15.972 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=- has_dir_layout 0x7f00f0016350) 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _put_inode on 0x10000000005.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) n = 15 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 remove_cap mds.0 on 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 15 client.4698 remove_cap last one, closing snaprealm 0x7f00f0007310 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 20 client.4698 put_snap_realm 0x1 0x7f00f0007310 1 -> 0 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 10 client.4698 _put_inode deleting 0x10000000005.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:15.946761+0000 mtime=2024-03-23T23:58:15.946761+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=1 caps=- objectset[0x10000000005 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00f0016930) 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 2 client.4698 _close_mds_session mds.0 seq 2 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 2) v7 -- 0x5611a127da00 con 0x5611a12fa280 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f010c985480 2 client.4698 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(grant ino 0x10000000005 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:15.946761+0000 ctime 2024-03-23T23:58:15.953499+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc042040 con 0x5611a12fa280 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 10 client.4698 mds.0 seq now 3 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 3) v7 -- 0x7f00f00070f0 con 0x5611a12fa280 2024-03-23T23:58:15.973 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 5 client.4698 handle_caps don't have vino 0x10000000005.head op 0, immediately releasing 2024-03-23T23:58:15.974 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_cap_release(3) v2 -- 0x5611a127d850 con 0x5611a12fa280 2024-03-23T23:58:15.974 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 10 client.4698 unmounting: trim pass, size was 0+0 2024-03-23T23:58:15.974 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 20 client.4698 trim_cache size 0 max 16384 2024-03-23T23:58:15.974 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.965+0000 7f0102000640 10 client.4698 unmounting: trim pass, size still 0+0 2024-03-23T23:58:15.975 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a127da00 con 0x5611a12fa280 2024-03-23T23:58:15.975 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 10 client.4698 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:15.975 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 5 client.4698 _closed_mds_session mds.0 seq 3 2024-03-23T23:58:15.975 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 1 -- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 10 client.4698 remove_session_caps mds.0 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 10 client.4698 kick_requests_closed for mds.0 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 10 client.4698 unmounting: trim pass, size was 0+0 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 20 client.4698 trim_cache size 0 max 16384 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f0102000640 10 client.4698 unmounting: trim pass, size still 0+0 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f010c985480 2 client.4698 unmounted. 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f010c985480 1 client.4698 shutdown 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 msgr2=0x5611a13130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.970+0000 7f010c985480 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0104034040 tx=0x7f0104040000 comp rx=0 tx=0).stop 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 shutdown_connections 2024-03-23T23:58:15.976 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 --2- 172.21.15.31:0/3394691519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 >> 172.21.15.31:0/3394691519 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 shutdown_connections 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 1 -- 172.21.15.31:0/3394691519 wait complete. 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.971+0000 7f010c985480 20 client.4698 trim_cache size 0 max 16384 2024-03-23T23:58:15.977 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritevNegativeIOVCount (57 ms) 2024-03-23T23:58:15.978 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritevZeroBytes 2024-03-23T23:58:15.980 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.972+0000 7f010c985480 1 -- start start 2024-03-23T23:58:15.980 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.973+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:15.980 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.980 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.980 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.980 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0008790 con 0x5611a1247e20 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a12f6920 con 0x5611a1249e70 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127ea90 con 0x5611a12466d0 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33502/0 (socket says 172.21.15.31:33502) 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f0103e00640 1 -- 172.21.15.31:0/4175396421 learned_addr learned my addr 172.21.15.31:0/4175396421 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f010a600640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.974+0000 7f0109c00640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f0103e00640 1 -- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f0103e00640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f0103e00640 1 -- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 msgr2=0x5611a13130d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f0103e00640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f0103e00640 1 -- 172.21.15.31:0/4175396421 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a8450 con 0x5611a1247e20 2024-03-23T23:58:15.981 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f010c985480 10 client.4701 Subscribing to map 'mdsmap' 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a12f76e0 con 0x5611a1247e20 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f00faa00640 20 client.4701 tick 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.975+0000 7f00faa00640 20 client.4701 collect_and_send_metrics 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f00faa00640 20 client.4701 collect_and_send_global_metrics 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f00faa00640 5 client.4701 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f00faa00640 20 client.4701 trim_cache size 0 max 16384 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f00faa00640 20 client.4701 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f0103e00640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a12758a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00f4000e50 tx=0x5611a1312e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5897ad513c0d98 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f0103400640 10 client.4701 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4057070 con 0x5611a1247e20 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00f404aae0 con 0x5611a1247e20 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00f4088070 con 0x5611a1247e20 2024-03-23T23:58:15.982 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f0103400640 1 client.4701 handle_mds_map epoch 8 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f010c985480 20 client.4701 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f010c985480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f010c985480 20 client.4701 mds is 0 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f010c985480 10 client.4701 _open_mds_session mds.0 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f010c985480 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a139db40 con 0x5611a12fa280 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.976+0000 7f010c985480 10 client.4701 waiting for session to mds.0 to open 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.977+0000 7f0109c00640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.978+0000 7f0109c00640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a2c10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef2922a42ea1b6dc server_cookie=9256782c0c7fa25e in_seq=0 out_seq=0 2024-03-23T23:58:15.983 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.978+0000 7f0103400640 10 client.4701 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x7f00fc009040 con 0x5611a12fa280 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f0103400640 10 client.4701 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f0103400640 10 client.4701 renew_caps mds.0 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d00093a0 con 0x5611a12fa280 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f0103400640 10 client.4701 connect_mds_targets for mds.0 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 10 client.4701 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 20 client.4701 mds is 0 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 10 client.4701 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:15.985 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 20 client.4701 encode_cap_releases enter (req: 0x5611a12f7ed0, mds: 0) 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 20 client.4701 send_request set sent_stamp to 2024-03-23T23:58:15.983304+0000 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 10 client.4701 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.977733+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.977733+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12765c0 con 0x5611a12fa280 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f010c985480 20 client.4701 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d00093a0 con 0x5611a12fa280 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.982+0000 7f0103400640 10 client.4701 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc0098d0 con 0x5611a12fa280 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 insert_trace from 2024-03-23T23:58:15.983304+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 features 0xffffffffffffffff 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 update_snap_trace len 70 2024-03-23T23:58:15.986 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 get_snap_realm 0x1 0x7f00d00095c0, nref now is 1 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 15 client.4701 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 15 client.4701 snapc 1=[] 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 put_snap_realm 0x1 0x7f00d00095c0 2 -> 1 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 hrm is_target=1 is_dentry=0 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d00096b0) - ctime 2024-03-23T23:58:15.953499+0000 mtime 2024-03-23T23:58:15.953499+0000 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 dir hash is 2 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 12 client.4701 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 11 2024-03-23T23:58:15.987 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 12 client.4701 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=- has_dir_layout 0x7f00d00096b0) caps pAsLsXsFs 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 get_snap_realm 0x1 0x7f00d00095c0, nref was 1 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 get_snap_realm 0x1 0x7f00d00095c0, nref now is 2 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 15 client.4701 add_update_cap first one, opened snaprealm 0x7f00d00095c0 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 add_update_cap calling signal_caps_inode 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 put_snap_realm 0x1 0x7f00d00095c0 2 -> 1 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 lat 0.001044 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 _ll_get 0x7f00d00096b0 0x1 -> 1 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 2 client.4701 unmount 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.988 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 unmounting: trim pass, size was 0+1 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 20 client.4701 trim_cache size 0 max 16384 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f0103400640 10 client.4701 unmounting: trim pass, size still 0+1 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 2 client.4701 unmounting 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 _ll_drop_pins 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 _ll_put 0x7f00d00096b0 0x1 1 -> 0 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) 2024-03-23T23:58:15.989 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 nothing to flush 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 1 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 flush_caps_sync 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 trim_cache size 0 max 16384 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) n = 8 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d00096b0) 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 15 client.4701 remove_cap last one, closing snaprealm 0x7f00d00095c0 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 20 client.4701 put_snap_realm 0x1 0x7f00d00095c0 1 -> 0 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 10 client.4701 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=- has_dir_layout 0x7f00d00096b0) 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 2 client.4701 _close_mds_session mds.0 seq 0 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a139db40 con 0x5611a12fa280 2024-03-23T23:58:15.990 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.983+0000 7f010c985480 2 client.4701 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a139db40 con 0x5611a12fa280 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 10 client.4701 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 5 client.4701 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 1 -- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 msgr2=0x5611a13a2c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a2c10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 10 client.4701 remove_session_caps mds.0 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 10 client.4701 kick_requests_closed for mds.0 2024-03-23T23:58:15.994 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 10 client.4701 unmounting: trim pass, size was 0+0 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 20 client.4701 trim_cache size 0 max 16384 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f0103400640 10 client.4701 unmounting: trim pass, size still 0+0 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 2 client.4701 unmounted. 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 client.4701 shutdown 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 msgr2=0x5611a12758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a12758a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f00f4000e50 tx=0x5611a1312e00 comp rx=0 tx=0).stop 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 shutdown_connections 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a2c10 unknown :-1 s=CLOSED pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1247e20 0x5611a12758a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 --2- 172.21.15.31:0/4175396421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 >> 172.21.15.31:0/4175396421 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:15.995 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.987+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 shutdown_connections 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.988+0000 7f010c985480 1 -- 172.21.15.31:0/4175396421 wait complete. 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.988+0000 7f010c985480 20 client.4701 trim_cache size 0 max 16384 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.988+0000 7f010c985480 1 -- start start 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.989+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.989+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.989+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.989+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.989+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0007cf0 con 0x5611a1249e70 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.989+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13b1d20 con 0x5611a1247e20 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.989+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a139deb0 con 0x5611a12466d0 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.996 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33508/0 (socket says 172.21.15.31:33508) 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 -- 172.21.15.31:0/2546399602 learned_addr learned my addr 172.21.15.31:0/2546399602 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f0103e00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f0109c00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 -- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 -- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f010a600640 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13089b0 con 0x5611a1249e70 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f0109c00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.990+0000 7f0103e00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1247e20 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f010a600640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f010404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1dc9130281141b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043030 con 0x5611a1249e70 2024-03-23T23:58:15.997 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104017a00 con 0x5611a1249e70 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f010c985480 10 client.4704 Subscribing to map 'mdsmap' 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a127da00 con 0x5611a1249e70 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f00fb400640 20 client.4704 tick 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f00fb400640 20 client.4704 collect_and_send_metrics 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f00fb400640 20 client.4704 collect_and_send_global_metrics 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f00fb400640 5 client.4704 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f00fb400640 20 client.4704 trim_cache size 0 max 16384 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.991+0000 7f00fb400640 20 client.4704 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104017c00 con 0x5611a1249e70 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a1249e70 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f0102000640 1 client.4704 handle_mds_map epoch 8 2024-03-23T23:58:15.998 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f010c985480 20 client.4704 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f010c985480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f010c985480 20 client.4704 mds is 0 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f010c985480 10 client.4704 _open_mds_session mds.0 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f010c985480 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a12f4480 con 0x5611a12fa280 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f010c985480 10 client.4704 waiting for session to mds.0 to open 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.992+0000 7f0109c00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.993+0000 7f0109c00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e908cd6addace31a server_cookie=8c93219f6cbeb258 in_seq=0 out_seq=0 2024-03-23T23:58:15.999 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.993+0000 7f0102000640 10 client.4704 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:16.001 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x7f00fc009040 con 0x5611a12fa280 2024-03-23T23:58:16.001 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f0102000640 10 client.4704 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:16.001 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f0102000640 10 client.4704 renew_caps mds.0 2024-03-23T23:58:16.001 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d00098f0 con 0x5611a12fa280 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f0102000640 10 client.4704 connect_mds_targets for mds.0 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f010c985480 10 client.4704 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f010c985480 20 client.4704 mds is 0 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f010c985480 10 client.4704 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f010c985480 20 client.4704 encode_cap_releases enter (req: 0x5611a124cf00, mds: 0) 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f010c985480 20 client.4704 send_request set sent_stamp to 2024-03-23T23:58:15.998967+0000 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f010c985480 10 client.4704 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.993125+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.997+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:15.993125+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a2cf0 con 0x5611a12fa280 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 20 client.4704 awaiting reply|forward|kick on 0x7ffef7334670 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d00098f0 con 0x5611a12fa280 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:16.002 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00b4a0 con 0x5611a12fa280 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 insert_trace from 2024-03-23T23:58:15.998967+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 features 0xffffffffffffffff 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 update_snap_trace len 70 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref now is 1 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 15 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 15 client.4704 snapc 1=[] 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 put_snap_realm 0x1 0x7f00d0009b10 2 -> 1 2024-03-23T23:58:16.003 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 hrm is_target=1 is_dentry=0 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d0009c00) - ctime 2024-03-23T23:58:15.953499+0000 mtime 2024-03-23T23:58:15.953499+0000 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 dir hash is 2 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 11 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 12 client.4704 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=- has_dir_layout 0x7f00d0009c00) caps pAsLsXsFs 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref was 1 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref now is 2 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f00d0009b10 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 10 client.4704 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 put_snap_realm 0x1 0x7f00d0009b10 2 -> 1 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 handle_client_reply signalling caller 0x7ffef7334670 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f0102000640 20 client.4704 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:16.004 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 20 client.4704 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 20 client.4704 lat 0.000998 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 20 client.4704 _ll_get 0x7f00d0009c00 0x1 -> 1 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevzerobytesfile44572 0666 578, uid 0, gid 0 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 10 client.4704 _do_lookup on #0x1/test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevzerobytesfile44572 => 3242905588 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.998+0000 7f010c985480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) is_hash=1 hash=3242905588 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 mds is 0 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 encode_cap_releases enter (req: 0x5611a13a2cf0, mds: 0) 2024-03-23T23:58:16.005 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 send_request set sent_stamp to 2024-03-23T23:58:16.000029+0000 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 send_request client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:15.999986+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:15.999986+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276450 con 0x5611a12fa280 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 awaiting reply|forward|kick on 0x7ffef7334420 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc00f800 con 0x5611a12fa280 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 10 client.4704 insert_trace from 2024-03-23T23:58:16.000029+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 10 client.4704 insert_trace -- no trace 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 20 client.4704 handle_client_reply signalling caller 0x7ffef7334420 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 20 client.4704 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:16.006 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 lat 0.000743 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 _do_lookup res is -2 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 _lookup 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) test_llreadvllwritevzerobytesfile44572 = -2 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 may_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 _getattr mask As issued=1 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 3 client.4704 may_create 0x7f00d0009c00 = 0 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 8 client.4704 _create(0x1 test_llreadvllwritevzerobytesfile44572, 0666) 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) name test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 15 open_dir 0x5611a1278420 on 0x7f00d0009c00 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 15 client.4704 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 'test_llreadvllwritevzerobytesfile44572' dn 0x1.head["test_llreadvllwritevzerobytesfile44572"] (new dn) 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevzerobytesfile44572 => 3242905588 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) is_hash=1 hash=3242905588 2024-03-23T23:58:16.007 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 mds is 0 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 encode_cap_releases enter (req: 0x5611a1276450, mds: 0) 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 encode_dentry_release enter(dn:0x7f00f0007310) 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00), req:0x5611a1276450 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 send_request set sent_stamp to 2024-03-23T23:58:16.000857+0000 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 10 client.4704 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.000822+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.000822+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276840 con 0x5611a12fa280 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f010c985480 20 client.4704 awaiting reply|forward|kick on 0x7ffef73344b0 2024-03-23T23:58:16.008 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:15.999+0000 7f0102000640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.009 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 859+0+0 (crc 0 0 0) 0x7f00fc00f9f0 con 0x5611a12fa280 2024-03-23T23:58:16.009 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:16.009 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 insert_trace from 2024-03-23T23:58:16.000857+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:16.009 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 features 0xffffffffffffffff 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 update_snap_trace len 70 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref was 1 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref now is 2 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 hrm is_target=1 is_dentry=1 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 update_inode_file_time 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) - ctime 2024-03-23T23:58:16.000822+0000 mtime 2024-03-23T23:58:16.000822+0000 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 12 client.4704 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 12 client.4704 add_update_inode adding 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=- objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref was 2 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref now is 3 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 15 client.4704 add_update_cap first one, opened snaprealm 0x7f00d0009b10 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) 2024-03-23T23:58:16.010 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 12 client.4704 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) caps pAsLsXsFs 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:15.953499+0000 ctime=2024-03-23T23:58:15.953499+0000 change_attr=11 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) pAsLsXs ctime 2024-03-23T23:58:16.000822+0000 mtime 2024-03-23T23:58:16.000822+0000 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 dir hash is 2 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 12 client.4704 add_update_inode client inode change_attr: 11 , mds inodestat change_attr: 12 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 10 client.4704 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 12 client.4704 insert_dentry_inode 'test_llreadvllwritevzerobytesfile44572' vino 0x10000000006.head in dir 0x1.head dn 0x7f00f0007310 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 15 client.4704 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 'test_llreadvllwritevzerobytesfile44572' to inode 0x7f00d000a1e0 dn 0x1.head["test_llreadvllwritevzerobytesfile44572"] (old dn) 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 link inode 0x7f00d000a1e0 parents now 0x1.head["test_llreadvllwritevzerobytesfile44572"] 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.011 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 15 client.4704 update_dentry_lease 0x1.head["test_llreadvllwritevzerobytesfile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:16.000857+0000 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 put_snap_realm 0x1 0x7f00d0009b10 3 -> 2 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 handle_client_reply signalling caller 0x7ffef73344b0 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 10 client.4704 delegated_inos: [] 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 10 client.4704 make_request created ino 0x10000000006 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 make_request target is 0x10000000006.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 lat 0.006427 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000006.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000006.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 10 client.4704 _create_fh 0x10000000006 mode 3 2024-03-23T23:58:16.012 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 trim_cache size 1 max 16384 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 8 client.4704 create(#0x1/test_llreadvllwritevzerobytesfile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 _ll_create created = 1 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 8 client.4704 _ll_create 0x1.head test_llreadvllwritevzerobytesfile44572 0666 578 = 0 (0x5611a13a3110 10000000006) 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 _ll_get 0x7f00d000a1e0 0x10000000006 -> 1 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 10 client.4704 fill_statx on 0x10000000006 snap/devhead mode 0100666 mtime 2024-03-23T23:58:16.000822+0000 ctime 2024-03-23T23:58:16.000822+0000 change_attr 0 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 3 client.4704 pwritev(0x5611a13a3110, "...", 0, 0) = -22 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a13a1660 0x5611a13b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] -- osd_op(unknown.0.0:1 3.25 3:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x5611a13b5570 con 0x5611a13a1660 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] -- osd_op(unknown.0.0:2 3.25 3:a5feb6f3:::10000000006.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23) v9 -- 0x5611a13b5dc0 con 0x5611a13a1660 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.006+0000 7f0102000640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.013 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.007+0000 7f0103e00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a13a1660 0x5611a13b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.014 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.008+0000 7f0103e00640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a13a1660 0x5611a13b5030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=ac6ebbec022ed448 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:16.014 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.008+0000 7f0102000640 10 client.4704 ms_handle_connect on v2:172.21.15.31:6800/2615987950 2024-03-23T23:58:16.014 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.008+0000 7f0103e00640 1 -- 172.21.15.31:0/2546399602 <== osd.1 v2:172.21.15.31:6800/2615987950 1 ==== osd_op_reply(1 10000000006.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a13a1660 2024-03-23T23:58:16.015 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.010+0000 7f0103e00640 1 -- 172.21.15.31:0/2546399602 <== osd.1 v2:172.21.15.31:6800/2615987950 2 ==== osd_op_reply(2 10000000006.00000000 [create] v23'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a13a1660 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 get_caps 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) have pAsxLsXsxFsxcrwb need Fr want Fc revoking - 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 _read_async 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=1} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 0~0 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 3 client.4704 preadv(0x5611a13a3110, 0) = 0 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 3 client.4704 ll_release (fh)0x5611a13a3110 0x10000000006 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 8 client.4704 _release_fh 0x5611a13a3110 mode 3 on 0x10000000006.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={2048=0} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 _flush 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 nothing to flush 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 check_caps on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 delaying cap release 2024-03-23T23:58:16.016 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 cap_delay_requeue on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 _release_fh 0x5611a13a3110 on inode 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) no async_err state 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 3 client.4704 ll_unlink 0x1.head test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 may_delete 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00); ; name test_llreadvllwritevzerobytesfile44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 _getattr mask As issued=1 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 3 client.4704 may_delete 0x7f00d0009c00 = 0 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 8 client.4704 _unlink(0x1 test_llreadvllwritevzerobytesfile44572 uid 0 gid 0) 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 get_or_create 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) name test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 _lookup have 0x1.head["test_llreadvllwritevzerobytesfile44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) test_llreadvllwritevzerobytesfile44572 = 0x10000000006.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) 2024-03-23T23:58:16.017 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 choose_target_mds inode dir hash is 2 on test_llreadvllwritevzerobytesfile44572 => 3242905588 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 choose_target_mds 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00) is_hash=1 hash=3242905588 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 choose_target_mds from dirfragtree hash 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 mds is 0 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 encode_cap_releases enter (req: 0x5611a1276840, mds: 0) 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 encode_inode_release enter(in:0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0), req:0x5611a1276840 mds:0, drop:LsxXx, unless:-, force:0) 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 encode_dentry_release enter(dn:0x7f00f0007310) 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009c00), req:0x5611a1276840 mds:0, drop:Fs, unless:Fx, force:1) 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 send_request set sent_stamp to 2024-03-23T23:58:16.012212+0000 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 10 client.4704 send_request client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.012164+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevzerobytesfile44572 2024-03-23T23:58:16.012164+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13b5910 con 0x5611a12fa280 2024-03-23T23:58:16.018 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.011+0000 7f010c985480 20 client.4704 awaiting reply|forward|kick on 0x7ffef7334690 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(revoke ino 0x10000000006 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.000822+0000 ctime 2024-03-23T23:58:16.000822+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a12fa280 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 5 client.4704 set_cap_epoch_barrier epoch = 21 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 mds.0 seq now 1 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 5 client.4704 handle_cap_grant on in 0x10000000006 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsFsxcrwb 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 update_inode_file_time 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) pAsxXsFsxcrwb ctime 2024-03-23T23:58:16.000822+0000 mtime 2024-03-23T23:58:16.000822+0000 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 revocation of Ax 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 check_caps on 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) wanted - used - issued pAsXsFsxcrwb revoking Ax flags=1 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsFsxcrwb revoking Ax 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 completed revocation of Ax 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 send_cap 0x10000000006.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevzerobytesfile44572"] 0x7f00d000a1e0) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsFsxcrwb revoking Ax dropping Fxcrwb 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 15 client.4704 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000006 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.000822+0000 ctime 2024-03-23T23:58:16.000822+0000 change_attr 0) v12 -- 0x7f00d000a7c0 con 0x5611a12fa280 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.012+0000 7f0102000640 10 client.4704 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:16.019 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:4 = 0 (0) Success unsafe) v1 ==== 507+0+0 (crc 0 0 0) 0x7f00fc023430 con 0x5611a12fa280 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 handle_client_reply got a reply. Safe:0 tid 4 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 insert_trace from 2024-03-23T23:58:16.012212+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 features 0xffffffffffffffff 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 update_snap_trace len 70 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref was 2 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 get_snap_realm 0x1 0x7f00d0009b10, nref now is 3 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 hrm is_target=0 is_dentry=1 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 12 client.4704 add_update_inode had 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) caps pAsLsXs 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 update_inode_file_time 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=12 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) pAsLsXs ctime 2024-03-23T23:58:16.012164+0000 mtime 2024-03-23T23:58:16.012164+0000 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 dir hash is 2 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 12 client.4704 add_update_inode client inode change_attr: 12 , mds inodestat change_attr: 13 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.020 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 15 client.4704 unlink dir 0x7f00d0009c00 'test_llreadvllwritevzerobytesfile44572' dn 0x7f00f0007310 inode 0x7f00d000a1e0 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 unlink inode 0x7f00d000a1e0 parents now 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 put_snap_realm 0x1 0x7f00d0009b10 3 -> 2 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 handle_client_reply signalling caller 0x7ffef7334690 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 handle_client_reply awaiting kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 20 client.4704 sendrecv kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 20 client.4704 lat 0.003070 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 20 client.4704 trim_cache size 1 max 16384 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 8 client.4704 unlink(#0x1/test_llreadvllwritevzerobytesfile44572) = 0 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.021 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 2 client.4704 unmount 2024-03-23T23:58:16.022 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 2 client.4704 unmounting 2024-03-23T23:58:16.022 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a13b5910 con 0x5611a12fa280 2024-03-23T23:58:16.022 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 10 client.4704 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:16.022 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 unmounting: trim pass, size was 1+2 2024-03-23T23:58:16.022 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 20 client.4704 trim_cache size 1 max 16384 2024-03-23T23:58:16.022 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f0102000640 10 client.4704 unmounting: trim pass, size still 1+2 2024-03-23T23:58:16.022 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.014+0000 7f010c985480 10 client.4704 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:16.023 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_caps(grant ino 0x10000000006 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.000822+0000 ctime 2024-03-23T23:58:16.012164+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d000a7c0 con 0x5611a12fa280 2024-03-23T23:58:16.023 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 mds.0 seq now 2 2024-03-23T23:58:16.023 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 5 client.4704 handle_cap_grant on in 0x10000000006 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-03-23T23:58:16.023 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 update_inode_file_time 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.000822+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) pAsXsFs ctime 2024-03-23T23:58:16.012164+0000 mtime 2024-03-23T23:58:16.000822+0000 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 max_size 4194304 -> 0 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 grant, new caps are LsFxcrwb 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 5 client.4704 _try_to_trim_inode in 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 unmounting: trim pass, size was 1+2 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 20 client.4704 trim_cache size 1 max 16384 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 unmounting: trim pass, size still 1+2 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:4 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc023790 con 0x5611a12fa280 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 20 client.4704 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 insert_trace from 2024-03-23T23:58:16.012212+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.024 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 unmounting: trim pass, size was 1+2 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 20 client.4704 trim_cache size 1 max 16384 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 15 client.4704 trim_dentry unlinking dn test_llreadvllwritevzerobytesfile44572 in dir 0x1 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 15 client.4704 unlink dir 0x7f00d0009c00 'test_llreadvllwritevzerobytesfile44572' dn 0x7f00f0007310 inode 0 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 15 client.4704 unlink removing 'test_llreadvllwritevzerobytesfile44572' dn 0x7f00f0007310 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 15 client.4704 close_dir dir 0x5611a1278420 on 0x7f00d0009c00 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f0102000640 10 client.4704 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _ll_drop_pins 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 _ll_put 0x7f00d000a1e0 0x10000000006 1 -> 0 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.025 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 _ll_put 0x7f00d0009c00 0x1 2 -> 0 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 _release 0x10000000006.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _invalidate_inode_cache 0x10000000006.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _flush 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 nothing to flush 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 _release 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _flush 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.026 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 nothing to flush 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 1 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 1 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 flush_caps_sync 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 trim_cache size 0 max 16384 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) n = 12 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 15 client.4704 remove_cap last one, closing snaprealm 0x7f00d0009b10 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_snap_realm 0x1 0x7f00d0009b10 2 -> 1 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=- has_dir_layout 0x7f00d0009c00) 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _put_inode on 0x10000000006.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) n = 15 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 remove_cap mds.0 on 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) 2024-03-23T23:58:16.027 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 15 client.4704 remove_cap last one, closing snaprealm 0x7f00d0009b10 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 20 client.4704 put_snap_realm 0x1 0x7f00d0009b10 1 -> 0 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 10 client.4704 _put_inode deleting 0x10000000006.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0,2048=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.000822+0000 mtime=2024-03-23T23:58:16.000822+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=1 caps=- objectset[0x10000000006 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a1e0) 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 2 client.4704 _close_mds_session mds.0 seq 2 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 2) v7 -- 0x5611a13a0e50 con 0x5611a12fa280 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.021+0000 7f010c985480 2 client.4704 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(grant ino 0x10000000006 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.000822+0000 ctime 2024-03-23T23:58:16.012164+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc042040 con 0x5611a12fa280 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 10 client.4704 mds.0 seq now 3 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 3) v7 -- 0x7f00d00098f0 con 0x5611a12fa280 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 5 client.4704 handle_caps don't have vino 0x10000000006.head op 0, immediately releasing 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_cap_release(3) v2 -- 0x5611a13a0ca0 con 0x5611a12fa280 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 10 client.4704 unmounting: trim pass, size was 0+0 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 20 client.4704 trim_cache size 0 max 16384 2024-03-23T23:58:16.028 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.022+0000 7f0102000640 10 client.4704 unmounting: trim pass, size still 0+0 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a13b5910 con 0x5611a12fa280 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 10 client.4704 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 5 client.4704 _closed_mds_session mds.0 seq 3 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 1 -- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a12fa280 0x5611a13a7dd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 10 client.4704 remove_session_caps mds.0 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 10 client.4704 kick_requests_closed for mds.0 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 10 client.4704 unmounting: trim pass, size was 0+0 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 20 client.4704 trim_cache size 0 max 16384 2024-03-23T23:58:16.030 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f0102000640 10 client.4704 unmounting: trim pass, size still 0+0 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 2 client.4704 unmounted. 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 1 client.4704 shutdown 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a13a1660 msgr2=0x5611a13b5030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a13a1660 0x5611a13b5030 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 msgr2=0x5611a13130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 1 --2- 172.21.15.31:0/2546399602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1249e70 0x5611a13130d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f010404e000 comp rx=0 tx=0).stop 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010a600640 1 -- 172.21.15.31:0/2546399602 reap_dead start 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 shutdown_connections 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.027+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 >> 172.21.15.31:0/2546399602 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.028+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 shutdown_connections 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.028+0000 7f010c985480 1 -- 172.21.15.31:0/2546399602 wait complete. 2024-03-23T23:58:16.031 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.028+0000 7f010c985480 20 client.4704 trim_cache size 0 max 16384 2024-03-23T23:58:16.032 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritevZeroBytes (56 ms) 2024-03-23T23:58:16.032 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.LlreadvLlwritevInvalidFileHandle 2024-03-23T23:58:16.034 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.029+0000 7f010c985480 1 -- start start 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.029+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.030+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.030+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.030+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1277440 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.030+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0006cf0 con 0x5611a1277440 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.030+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a127b500 con 0x5611a12466d0 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.030+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13019d0 con 0x5611a139e080 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1277440 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f0103e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1277440 0x5611a13a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33524/0 (socket says 172.21.15.31:33524) 2024-03-23T23:58:16.035 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 -- 172.21.15.31:0/1517595559 learned_addr learned my addr 172.21.15.31:0/1517595559 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 -- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139e080 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 -- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 msgr2=0x5611a13130d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.031+0000 7f010a600640 1 -- 172.21.15.31:0/1517595559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1279650 con 0x5611a1277440 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f010a600640 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1277440 0x5611a13a5470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0104034040 tx=0x7f0104046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aae58efadea4b76 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043040 con 0x5611a1277440 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104058850 con 0x5611a1277440 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f010c985480 10 client.4707 Subscribing to map 'mdsmap' 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a1234de0 con 0x5611a1277440 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f00faa00640 20 client.4707 tick 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f00faa00640 20 client.4707 collect_and_send_metrics 2024-03-23T23:58:16.036 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f00faa00640 20 client.4707 collect_and_send_global_metrics 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f00faa00640 5 client.4707 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f00faa00640 20 client.4707 trim_cache size 0 max 16384 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.032+0000 7f00faa00640 20 client.4707 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104058a50 con 0x5611a1277440 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a1277440 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f0103400640 1 client.4707 handle_mds_map epoch 8 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f010c985480 20 client.4707 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f010c985480 10 client.4707 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f010c985480 20 client.4707 mds is 0 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f010c985480 10 client.4707 _open_mds_session mds.0 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f010c985480 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13b1cd0 con 0x5611a139db40 2024-03-23T23:58:16.037 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f010c985480 10 client.4707 waiting for session to mds.0 to open 2024-03-23T23:58:16.038 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.033+0000 7f0109c00640 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.038 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.035+0000 7f0103400640 10 client.4707 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:16.038 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.035+0000 7f0109c00640 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a12f75b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f7bb48ae726b9b8 server_cookie=590e189174a6f081 in_seq=0 out_seq=0 2024-03-23T23:58:16.038 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.038+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a13b1cd0 con 0x5611a139db40 2024-03-23T23:58:16.038 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.038+0000 7f0103400640 10 client.4707 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:16.038 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.038+0000 7f0103400640 10 client.4707 renew_caps mds.0 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.038+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0009c50 con 0x5611a139db40 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f0103400640 10 client.4707 connect_mds_targets for mds.0 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 10 client.4707 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 20 client.4707 mds is 0 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 10 client.4707 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 20 client.4707 encode_cap_releases enter (req: 0x5611a13b5970, mds: 0) 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 20 client.4707 send_request set sent_stamp to 2024-03-23T23:58:16.040049+0000 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 10 client.4707 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.034310+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.034310+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13b5040 con 0x5611a139db40 2024-03-23T23:58:16.039 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f010c985480 20 client.4707 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:16.041 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0009c50 con 0x5611a139db40 2024-03-23T23:58:16.041 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.039+0000 7f0103400640 10 client.4707 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:16.041 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00b4a0 con 0x5611a139db40 2024-03-23T23:58:16.041 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:16.041 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 insert_trace from 2024-03-23T23:58:16.040049+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:16.041 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 features 0xffffffffffffffff 2024-03-23T23:58:16.041 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 update_snap_trace len 70 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 get_snap_realm 0x1 0x7f00d0009e70, nref now is 1 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 15 client.4707 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 15 client.4707 snapc 1=[] 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 put_snap_realm 0x1 0x7f00d0009e70 2 -> 1 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 hrm is_target=1 is_dentry=0 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d0009f60) - ctime 2024-03-23T23:58:16.012164+0000 mtime 2024-03-23T23:58:16.012164+0000 2024-03-23T23:58:16.042 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 dir hash is 2 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 12 client.4707 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 13 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 12 client.4707 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=- has_dir_layout 0x7f00d0009f60) caps pAsLsXsFs 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 get_snap_realm 0x1 0x7f00d0009e70, nref was 1 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 get_snap_realm 0x1 0x7f00d0009e70, nref now is 2 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 15 client.4707 add_update_cap first one, opened snaprealm 0x7f00d0009e70 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 put_snap_realm 0x1 0x7f00d0009e70 2 -> 1 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 lat 0.001086 2024-03-23T23:58:16.043 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 _ll_get 0x7f00d0009f60 0x1 -> 1 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 3 client.4707 (fh)0 is invalid 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 3 client.4707 (fh)0 is invalid 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 2 client.4707 unmount 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 unmounting: trim pass, size was 0+1 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 20 client.4707 trim_cache size 0 max 16384 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f0103400640 10 client.4707 unmounting: trim pass, size still 0+1 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 2 client.4707 unmounting 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.044 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 _ll_drop_pins 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 _ll_put 0x7f00d0009f60 0x1 1 -> 0 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 nothing to flush 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 1 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 flush_caps_sync 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:16.045 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 trim_cache size 0 max 16384 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) n = 8 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f60) 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 15 client.4707 remove_cap last one, closing snaprealm 0x7f00d0009e70 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 20 client.4707 put_snap_realm 0x1 0x7f00d0009e70 1 -> 0 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 10 client.4707 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=- has_dir_layout 0x7f00d0009f60) 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 2 client.4707 _close_mds_session mds.0 seq 0 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a13b51f0 con 0x5611a139db40 2024-03-23T23:58:16.046 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.040+0000 7f010c985480 2 client.4707 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a13b51f0 con 0x5611a139db40 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 10 client.4707 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 5 client.4707 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 1 -- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 msgr2=0x5611a12f75b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a12f75b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 10 client.4707 remove_session_caps mds.0 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 10 client.4707 kick_requests_closed for mds.0 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 10 client.4707 unmounting: trim pass, size was 0+0 2024-03-23T23:58:16.050 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 20 client.4707 trim_cache size 0 max 16384 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f0103400640 10 client.4707 unmounting: trim pass, size still 0+0 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 2 client.4707 unmounted. 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 client.4707 shutdown 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1277440 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1277440 0x5611a13a5470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0104034040 tx=0x7f0104046000 comp rx=0 tx=0).stop 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 shutdown_connections 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1277440 0x5611a13a5470 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 --2- 172.21.15.31:0/1517595559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 >> 172.21.15.31:0/1517595559 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.044+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 shutdown_connections 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.045+0000 7f010c985480 1 -- 172.21.15.31:0/1517595559 wait complete. 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.045+0000 7f010c985480 20 client.4707 trim_cache size 0 max 16384 2024-03-23T23:58:16.051 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.045+0000 7f010c985480 1 -- start start 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.046+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.046+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.046+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.046+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.046+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0005320 con 0x5611a139e080 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.046+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1245cb0 con 0x5611a139db40 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.046+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a1312b50 con 0x5611a12466d0 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33530/0 (socket says 172.21.15.31:33530) 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 -- 172.21.15.31:0/1736747161 learned_addr learned my addr 172.21.15.31:0/1736747161 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f0103e00640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f0109c00640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.052 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 -- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 -- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 msgr2=0x5611a12f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f010a600640 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a12fa280 con 0x5611a139e080 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.047+0000 7f0103e00640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f010a600640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a12758a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f0104026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867fb3c1b9e84ff0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043070 con 0x5611a139e080 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f010403d830 con 0x5611a139e080 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f010c985480 10 client.4710 Subscribing to map 'mdsmap' 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a1249e70 con 0x5611a139e080 2024-03-23T23:58:16.053 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f00fb400640 20 client.4710 tick 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f00fb400640 20 client.4710 collect_and_send_metrics 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f00fb400640 20 client.4710 collect_and_send_global_metrics 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f00fb400640 5 client.4710 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f00fb400640 20 client.4710 trim_cache size 0 max 16384 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f00fb400640 20 client.4710 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010403da70 con 0x5611a139e080 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a139e080 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.048+0000 7f0102000640 1 client.4710 handle_mds_map epoch 8 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f010c985480 20 client.4710 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f010c985480 10 client.4710 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f010c985480 20 client.4710 mds is 0 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f010c985480 10 client.4710 _open_mds_session mds.0 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f010c985480 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.054 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127dfb0 con 0x5611a1232360 2024-03-23T23:58:16.055 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f010c985480 10 client.4710 waiting for session to mds.0 to open 2024-03-23T23:58:16.055 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.049+0000 7f0109c00640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.055 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.050+0000 7f0109c00640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1232360 0x5611a13a7dd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c57ecbcefc26ba server_cookie=5a30cbdd0a6e67fe in_seq=0 out_seq=0 2024-03-23T23:58:16.055 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.050+0000 7f0102000640 10 client.4710 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:16.056 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.054+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127dfb0 con 0x5611a1232360 2024-03-23T23:58:16.056 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.054+0000 7f0102000640 10 client.4710 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:16.056 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.054+0000 7f0102000640 10 client.4710 renew_caps mds.0 2024-03-23T23:58:16.056 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.054+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0009c00 con 0x5611a1232360 2024-03-23T23:58:16.056 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.054+0000 7f0102000640 10 client.4710 connect_mds_targets for mds.0 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.054+0000 7f010c985480 10 client.4710 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.054+0000 7f010c985480 20 client.4710 mds is 0 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f010c985480 10 client.4710 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f010c985480 20 client.4710 encode_cap_releases enter (req: 0x5611a13b50a0, mds: 0) 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f010c985480 20 client.4710 send_request set sent_stamp to 2024-03-23T23:58:16.056016+0000 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f010c985480 10 client.4710 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.050055+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.050055+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127cd60 con 0x5611a1232360 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f010c985480 20 client.4710 awaiting reply|forward|kick on 0x7ffef7334630 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0009c00 con 0x5611a1232360 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.055+0000 7f0102000640 10 client.4710 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:16.057 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00b4a0 con 0x5611a1232360 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 insert_trace from 2024-03-23T23:58:16.056016+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 features 0xffffffffffffffff 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 update_snap_trace len 70 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref now is 1 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 15 client.4710 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 15 client.4710 snapc 1=[] 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 put_snap_realm 0x1 0x7f00d0009e20 2 -> 1 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 hrm is_target=1 is_dentry=0 2024-03-23T23:58:16.058 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d0009f10) - ctime 2024-03-23T23:58:16.012164+0000 mtime 2024-03-23T23:58:16.012164+0000 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 dir hash is 2 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 12 client.4710 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 13 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 12 client.4710 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=- has_dir_layout 0x7f00d0009f10) caps pAsLsXsFs 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref was 1 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref now is 2 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 15 client.4710 add_update_cap first one, opened snaprealm 0x7f00d0009e20 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 10 client.4710 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 put_snap_realm 0x1 0x7f00d0009e20 2 -> 1 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 handle_client_reply signalling caller 0x7ffef7334630 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 lat 0.001132 2024-03-23T23:58:16.059 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 _ll_get 0x7f00d0009f10 0x1 -> 1 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 8 client.4710 _ll_create 0x1.head test_llreadvllwritevinvalidfhfile44572 0666 578, uid 0, gid 0 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 10 client.4710 _do_lookup on #0x1/test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 choose_target_mds inode dir hash is 2 on test_llreadvllwritevinvalidfhfile44572 => 1546474863 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 choose_target_mds 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) is_hash=1 hash=1546474863 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 10 client.4710 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 mds is 0 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 10 client.4710 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 encode_cap_releases enter (req: 0x5611a127cd60, mds: 0) 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 send_request set sent_stamp to 2024-03-23T23:58:16.057199+0000 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 10 client.4710 send_request client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.057169+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.057169+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127d1b0 con 0x5611a1232360 2024-03-23T23:58:16.060 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f010c985480 20 client.4710 awaiting reply|forward|kick on 0x7ffef73343e0 2024-03-23T23:58:16.061 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.061 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.056+0000 7f0102000640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.061 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc0098d0 con 0x5611a1232360 2024-03-23T23:58:16.061 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f0102000640 20 client.4710 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:16.061 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f0102000640 10 client.4710 insert_trace from 2024-03-23T23:58:16.057199+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f0102000640 10 client.4710 insert_trace -- no trace 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f0102000640 20 client.4710 handle_client_reply signalling caller 0x7ffef73343e0 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f0102000640 20 client.4710 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 lat 0.002153 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 10 client.4710 _do_lookup res is -2 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 10 client.4710 _lookup 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) test_llreadvllwritevinvalidfhfile44572 = -2 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 may_create 0x1.head(faked_ino=0 nref=7 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 10 client.4710 _getattr mask As issued=1 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 3 client.4710 may_create 0x7f00d0009f10 = 0 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 8 client.4710 _create(0x1 test_llreadvllwritevinvalidfhfile44572, 0666) 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 get_or_create 0x1.head(faked_ino=0 nref=8 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) name test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.062 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 15 open_dir 0x5611a13b53d0 on 0x7f00d0009f10 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 15 client.4710 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 'test_llreadvllwritevinvalidfhfile44572' dn 0x1.head["test_llreadvllwritevinvalidfhfile44572"] (new dn) 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 choose_target_mds inode dir hash is 2 on test_llreadvllwritevinvalidfhfile44572 => 1546474863 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 choose_target_mds 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) is_hash=1 hash=1546474863 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 10 client.4710 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 mds is 0 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 10 client.4710 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 encode_cap_releases enter (req: 0x5611a13a0e50, mds: 0) 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 encode_dentry_release enter(dn:0x7f00d0009b10) 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10), req:0x5611a13a0e50 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 send_request set sent_stamp to 2024-03-23T23:58:16.059449+0000 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 10 client.4710 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.059413+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.063 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.059413+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a11c0 con 0x5611a1232360 2024-03-23T23:58:16.064 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f010c985480 20 client.4710 awaiting reply|forward|kick on 0x7ffef7334470 2024-03-23T23:58:16.064 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.058+0000 7f0102000640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.068 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 859+0+0 (crc 0 0 0) 0x7f00fc009ac0 con 0x5611a1232360 2024-03-23T23:58:16.068 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:16.068 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 insert_trace from 2024-03-23T23:58:16.059449+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:16.068 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 features 0xffffffffffffffff 2024-03-23T23:58:16.068 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 update_snap_trace len 70 2024-03-23T23:58:16.068 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref was 1 2024-03-23T23:58:16.068 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref now is 2 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 hrm is_target=1 is_dentry=1 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 update_inode_file_time 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) - ctime 2024-03-23T23:58:16.059413+0000 mtime 2024-03-23T23:58:16.059413+0000 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 12 client.4710 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 12 client.4710 add_update_inode adding 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=- objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref was 2 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref now is 3 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 15 client.4710 add_update_cap first one, opened snaprealm 0x7f00d0009e20 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100666 size=0/0 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 12 client.4710 add_update_inode had 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) caps pAsLsXsFs 2024-03-23T23:58:16.069 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 update_inode_file_time 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.012164+0000 ctime=2024-03-23T23:58:16.012164+0000 change_attr=13 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) pAsLsXs ctime 2024-03-23T23:58:16.059413+0000 mtime 2024-03-23T23:58:16.059413+0000 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 dir hash is 2 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 12 client.4710 add_update_inode client inode change_attr: 13 , mds inodestat change_attr: 14 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 10 client.4710 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 12 client.4710 insert_dentry_inode 'test_llreadvllwritevinvalidfhfile44572' vino 0x10000000007.head in dir 0x1.head dn 0x7f00d0009b10 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 15 client.4710 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 'test_llreadvllwritevinvalidfhfile44572' to inode 0x7f00d000a4f0 dn 0x1.head["test_llreadvllwritevinvalidfhfile44572"] (old dn) 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 link inode 0x7f00d000a4f0 parents now 0x1.head["test_llreadvllwritevinvalidfhfile44572"] 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 15 client.4710 update_dentry_lease 0x1.head["test_llreadvllwritevinvalidfhfile44572"] lease(mask 0 dur 0) from 2024-03-23T23:58:16.059449+0000 2024-03-23T23:58:16.070 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 put_snap_realm 0x1 0x7f00d0009e20 3 -> 2 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 handle_client_reply signalling caller 0x7ffef7334470 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.066+0000 7f0102000640 20 client.4710 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 delegated_inos: [] 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 make_request created ino 0x10000000007 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 make_request target is 0x10000000007.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 lat 0.008610 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000007.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000007.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 _create_fh 0x10000000007 mode 3 2024-03-23T23:58:16.071 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 trim_cache size 1 max 16384 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 8 client.4710 create(#0x1/test_llreadvllwritevinvalidfhfile44572, 0100666 layout 0 0 0) = 0 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 _ll_create created = 1 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 8 client.4710 _ll_create 0x1.head test_llreadvllwritevinvalidfhfile44572 0666 578 = 0 (0x5611a1249e70 10000000007) 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 _ll_get 0x7f00d000a4f0 0x10000000007 -> 1 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 fill_statx on 0x10000000007 snap/devhead mode 0100666 mtime 2024-03-23T23:58:16.059413+0000 ctime 2024-03-23T23:58:16.059413+0000 change_attr 0 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 3 client.4710 ll_release (fh)0x5611a1249e70 0x10000000007 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 8 client.4710 _release_fh 0x5611a1249e70 mode 3 on 0x10000000007.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={3=1} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 _flush 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 nothing to flush 2024-03-23T23:58:16.072 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 check_caps on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 delaying cap release 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 cap_delay_requeue on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 _release_fh 0x5611a1249e70 on inode 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) no async_err state 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 3 client.4710 ll_unlink 0x1.head test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 may_delete 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10); ; name test_llreadvllwritevinvalidfhfile44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 _getattr mask As issued=1 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 3 client.4710 may_delete 0x7f00d0009f10 = 0 2024-03-23T23:58:16.073 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 8 client.4710 _unlink(0x1 test_llreadvllwritevinvalidfhfile44572 uid 0 gid 0) 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 get_or_create 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) name test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 _lookup have 0x1.head["test_llreadvllwritevinvalidfhfile44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) test_llreadvllwritevinvalidfhfile44572 = 0x10000000007.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 choose_target_mds inode dir hash is 2 on test_llreadvllwritevinvalidfhfile44572 => 1546474863 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 choose_target_mds 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) is_hash=1 hash=1546474863 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 choose_target_mds from dirfragtree hash 2024-03-23T23:58:16.074 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 mds is 0 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 encode_cap_releases enter (req: 0x5611a13a11c0, mds: 0) 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 encode_inode_release enter(in:0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0), req:0x5611a13a11c0 mds:0, drop:LsxXx, unless:-, force:0) 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 encode_dentry_release enter(dn:0x7f00d0009b10) 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10), req:0x5611a13a11c0 mds:0, drop:Fs, unless:Fx, force:1) 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 send_request set sent_stamp to 2024-03-23T23:58:16.068404+0000 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 10 client.4710 send_request client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.068363+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 unlink #0x1/test_llreadvllwritevinvalidfhfile44572 2024-03-23T23:58:16.068363+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127a9c0 con 0x5611a1232360 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f010c985480 20 client.4710 awaiting reply|forward|kick on 0x7ffef7334650 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f0102000640 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.075 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.067+0000 7f0102000640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(revoke ino 0x10000000007 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.059413+0000 ctime 2024-03-23T23:58:16.059413+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc042040 con 0x5611a1232360 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 5 client.4710 set_cap_epoch_barrier epoch = 21 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 mds.0 seq now 1 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 5 client.4710 handle_cap_grant on in 0x10000000007 mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsFsxcrwb 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 update_inode_file_time 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsxXsFsxcrwb(0=pAsxXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) pAsxXsFsxcrwb ctime 2024-03-23T23:58:16.059413+0000 mtime 2024-03-23T23:58:16.059413+0000 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 revocation of Ax 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 check_caps on 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) wanted - used - issued pAsXsFsxcrwb revoking Ax flags=1 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsFsxcrwb revoking Ax 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 completed revocation of Ax 2024-03-23T23:58:16.076 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 send_cap 0x10000000007.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["test_llreadvllwritevinvalidfhfile44572"] 0x7f00d000a4f0) mds.0 seq 2 used - want - flush - retain pAsLsXsFs held pAsxXsFsxcrwb revoking Ax dropping Fxcrwb 2024-03-23T23:58:16.077 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 15 client.4710 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:16.077 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000007 1 seq 2 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.059413+0000 ctime 2024-03-23T23:58:16.059413+0000 change_attr 0) v12 -- 0x7f00d000aad0 con 0x5611a1232360 2024-03-23T23:58:16.077 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.068+0000 7f0102000640 10 client.4710 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:16.078 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:4 = 0 (0) Success unsafe) v1 ==== 507+0+0 (crc 0 0 0) 0x7f00fc00fa60 con 0x5611a1232360 2024-03-23T23:58:16.078 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 handle_client_reply got a reply. Safe:0 tid 4 2024-03-23T23:58:16.078 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 10 client.4710 insert_trace from 2024-03-23T23:58:16.068404+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:16.078 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 10 client.4710 features 0xffffffffffffffff 2024-03-23T23:58:16.078 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 10 client.4710 update_snap_trace len 70 2024-03-23T23:58:16.078 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref was 2 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 get_snap_realm 0x1 0x7f00d0009e20, nref now is 3 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 10 client.4710 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 10 client.4710 hrm is_target=0 is_dentry=1 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 12 client.4710 add_update_inode had 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) caps pAsLsXs 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 10 client.4710 update_inode_file_time 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=14 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) pAsLsXs ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 dir hash is 2 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 12 client.4710 add_update_inode client inode change_attr: 14 , mds inodestat change_attr: 15 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 10 client.4710 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 15 client.4710 unlink dir 0x7f00d0009f10 'test_llreadvllwritevinvalidfhfile44572' dn 0x7f00d0009b10 inode 0x7f00d000a4f0 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.079 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 unlink inode 0x7f00d000a4f0 parents now 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 put_snap_realm 0x1 0x7f00d0009e20 3 -> 2 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 handle_client_reply signalling caller 0x7ffef7334650 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f0102000640 20 client.4710 handle_client_reply awaiting kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 20 client.4710 sendrecv kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 20 client.4710 lat 0.005263 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 20 client.4710 trim_cache size 1 max 16384 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 8 client.4710 unlink(#0x1/test_llreadvllwritevinvalidfhfile44572) = 0 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=1 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 3 client.4710 (fh)0x5611a1249e70 is invalid 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 3 client.4710 (fh)0x5611a1249e70 is invalid 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 2 client.4710 unmount 2024-03-23T23:58:16.080 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 2 client.4710 unmounting 2024-03-23T23:58:16.081 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a13a20d0 con 0x5611a1232360 2024-03-23T23:58:16.081 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.072+0000 7f010c985480 10 client.4710 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:16.082 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_caps(grant ino 0x10000000007 1 seq 3 caps=pAsLsXsFsxcrwb dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.059413+0000 ctime 2024-03-23T23:58:16.068363+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d000aad0 con 0x5611a1232360 2024-03-23T23:58:16.082 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 mds.0 seq now 2 2024-03-23T23:58:16.082 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 5 client.4710 handle_cap_grant on in 0x10000000007 mds.0 seq 3 caps now pAsLsXsFsxcrwb was pAsXsFs 2024-03-23T23:58:16.082 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 update_inode_file_time 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/4194304 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.059413+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) pAsXsFs ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.059413+0000 2024-03-23T23:58:16.082 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 max_size 4194304 -> 0 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 grant, new caps are LsFxcrwb 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 5 client.4710 _try_to_trim_inode in 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 unmounting: trim pass, size was 1+2 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 20 client.4710 trim_cache size 1 max 16384 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 unmounting: trim pass, size still 1+2 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:4 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc023430 con 0x5611a1232360 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 20 client.4710 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 insert_trace from 2024-03-23T23:58:16.068404+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.083 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 unmounting: trim pass, size was 1+2 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 20 client.4710 trim_cache size 1 max 16384 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 15 client.4710 trim_dentry unlinking dn test_llreadvllwritevinvalidfhfile44572 in dir 0x1 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 15 client.4710 unlink dir 0x7f00d0009f10 'test_llreadvllwritevinvalidfhfile44572' dn 0x7f00d0009b10 inode 0 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 15 client.4710 unlink removing 'test_llreadvllwritevinvalidfhfile44572' dn 0x7f00d0009b10 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 15 client.4710 close_dir dir 0x5611a13b53d0 on 0x7f00d0009f10 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f0102000640 10 client.4710 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=2 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _ll_drop_pins 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 _ll_put 0x7f00d000a4f0 0x10000000007 1 -> 0 2024-03-23T23:58:16.084 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 _ll_put 0x7f00d0009f10 0x1 2 -> 0 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 _release 0x10000000007.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _invalidate_inode_cache 0x10000000007.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _flush 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 nothing to flush 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 _release 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _flush 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 nothing to flush 2024-03-23T23:58:16.085 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 flush_caps_sync 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 trim_cache size 0 max 16384 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 12 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 15 client.4710 remove_cap last one, closing snaprealm 0x7f00d0009e20 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_snap_realm 0x1 0x7f00d0009e20 2 -> 1 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _put_inode on 0x10000000007.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) n = 15 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 remove_cap mds.0 on 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) 2024-03-23T23:58:16.086 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 15 client.4710 remove_cap last one, closing snaprealm 0x7f00d0009e20 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 20 client.4710 put_snap_realm 0x1 0x7f00d0009e20 1 -> 0 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 10 client.4710 _put_inode deleting 0x10000000007.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={3=0} mode=100666 size=0/0 nlink=0 btime=2024-03-23T23:58:16.059413+0000 mtime=2024-03-23T23:58:16.059413+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=1 caps=- objectset[0x10000000007 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a4f0) 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 2 client.4710 _close_mds_session mds.0 seq 2 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.079+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 2) v7 -- 0x5611a127ad50 con 0x5611a1232360 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f010c985480 2 client.4710 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(grant ino 0x10000000007 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:16.059413+0000 ctime 2024-03-23T23:58:16.068363+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a1232360 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 10 client.4710 mds.0 seq now 3 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 3) v7 -- 0x7f00d0009c00 con 0x5611a1232360 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 5 client.4710 handle_caps don't have vino 0x10000000007.head op 0, immediately releasing 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_cap_release(3) v2 -- 0x5611a127a9c0 con 0x5611a1232360 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 10 client.4710 unmounting: trim pass, size was 0+0 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 20 client.4710 trim_cache size 0 max 16384 2024-03-23T23:58:16.087 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.080+0000 7f0102000640 10 client.4710 unmounting: trim pass, size still 0+0 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a13a20d0 con 0x5611a1232360 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 10 client.4710 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 5 client.4710 _closed_mds_session mds.0 seq 3 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 1 -- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1232360 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1232360 0x5611a13a7dd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 10 client.4710 remove_session_caps mds.0 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 10 client.4710 kick_requests_closed for mds.0 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 10 client.4710 unmounting: trim pass, size was 0+0 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 20 client.4710 trim_cache size 0 max 16384 2024-03-23T23:58:16.089 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f0102000640 10 client.4710 unmounting: trim pass, size still 0+0 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 2 client.4710 unmounted. 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 client.4710 shutdown 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 msgr2=0x5611a12758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a12758a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f0104026000 comp rx=0 tx=0).stop 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 shutdown_connections 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a12758a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 --2- 172.21.15.31:0/1736747161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.084+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 >> 172.21.15.31:0/1736747161 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.085+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 shutdown_connections 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.085+0000 7f010c985480 1 -- 172.21.15.31:0/1736747161 wait complete. 2024-03-23T23:58:16.090 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.085+0000 7f010c985480 20 client.4710 trim_cache size 0 max 16384 2024-03-23T23:58:16.091 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.LlreadvLlwritevInvalidFileHandle (57 ms) 2024-03-23T23:58:16.091 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.CheckDummyOP 2024-03-23T23:58:16.093 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.086+0000 7f010c985480 1 -- start start 2024-03-23T23:58:16.093 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.087+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:16.093 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.087+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.087+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.087+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.087+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0008560 con 0x5611a12466d0 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.087+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1246b50 con 0x5611a1232360 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.087+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127db70 con 0x5611a139db40 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33532/0 (socket says 172.21.15.31:33532) 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 -- 172.21.15.31:0/721221773 learned_addr learned my addr 172.21.15.31:0/721221773 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f010a600640 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 -- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.094 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 -- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 msgr2=0x5611a12f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.088+0000 7f0103e00640 1 -- 172.21.15.31:0/721221773 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13019d0 con 0x5611a12466d0 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f0103e00640 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a12758a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5611a13a92a0 tx=0x5611a13b1450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6e3ff2a09b5b54 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4066b60 con 0x5611a12466d0 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f00f4066d00 con 0x5611a12466d0 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f010c985480 10 client.4713 Subscribing to map 'mdsmap' 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a12f4b50 con 0x5611a12466d0 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f00faa00640 20 client.4713 tick 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f00faa00640 20 client.4713 collect_and_send_metrics 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f00faa00640 20 client.4713 collect_and_send_global_metrics 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f00faa00640 5 client.4713 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:16.095 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f00faa00640 20 client.4713 trim_cache size 0 max 16384 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.089+0000 7f00faa00640 20 client.4713 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611a12f87d0 con 0x5611a12466d0 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00f4094070 con 0x5611a12466d0 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f0103400640 1 client.4713 handle_mds_map epoch 8 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f010c985480 20 client.4713 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f010c985480 10 client.4713 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f010c985480 20 client.4713 mds is 0 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f010c985480 10 client.4713 _open_mds_session mds.0 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f010c985480 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127df40 con 0x5611a139e080 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f010c985480 10 client.4713 waiting for session to mds.0 to open 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.090+0000 7f0109c00640 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.091+0000 7f0103400640 10 client.4713 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:16.096 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.091+0000 7f0109c00640 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a89cf80510529ee server_cookie=9ce5a877df9a872b in_seq=0 out_seq=0 2024-03-23T23:58:16.098 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127df40 con 0x5611a139e080 2024-03-23T23:58:16.098 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f0103400640 10 client.4713 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f0103400640 10 client.4713 renew_caps mds.0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0002b60 con 0x5611a139e080 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f0103400640 10 client.4713 connect_mds_targets for mds.0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 10 client.4713 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 20 client.4713 mds is 0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 10 client.4713 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 20 client.4713 encode_cap_releases enter (req: 0x5611a127cd60, mds: 0) 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 20 client.4713 send_request set sent_stamp to 2024-03-23T23:58:16.096890+0000 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 10 client.4713 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.091260+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.091260+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a124c680 con 0x5611a139e080 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.095+0000 7f010c985480 20 client.4713 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.096+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0002b60 con 0x5611a139e080 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.096+0000 7f0103400640 10 client.4713 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:16.099 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00f450 con 0x5611a139e080 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 insert_trace from 2024-03-23T23:58:16.096890+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 features 0xffffffffffffffff 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 update_snap_trace len 70 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 get_snap_realm 0x1 0x7f00d0009f10, nref now is 1 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 15 client.4713 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 15 client.4713 snapc 1=[] 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.100 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 put_snap_realm 0x1 0x7f00d0009f10 2 -> 1 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 hrm is_target=1 is_dentry=0 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a000) - ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 dir hash is 2 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 12 client.4713 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 12 client.4713 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d000a000) caps pAsLsXsFs 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 get_snap_realm 0x1 0x7f00d0009f10, nref was 1 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 get_snap_realm 0x1 0x7f00d0009f10, nref now is 2 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 15 client.4713 add_update_cap first one, opened snaprealm 0x7f00d0009f10 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 10 client.4713 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.101 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 put_snap_realm 0x1 0x7f00d0009f10 2 -> 1 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 20 client.4713 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 20 client.4713 lat 0.001598 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 20 client.4713 _ll_get 0x7f00d000a000 0x1 -> 1 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 10 client.4713 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 20 client.4713 mds is 0 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 10 client.4713 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 1 client.4713 Warning -- unable to construct a filepath! No path, inode, or dentry given! 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 20 client.4713 encode_cap_releases enter (req: 0x5611a124c680, mds: 0) 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 20 client.4713 send_request set sent_stamp to 2024-03-23T23:58:16.098513+0000 2024-03-23T23:58:16.102 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 10 client.4713 send_request client_request(unknown.0:2 dummy 2024-03-23T23:58:16.098501+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 dummy 2024-03-23T23:58:16.098501+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127ab70 con 0x5611a139e080 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f010c985480 20 client.4713 awaiting reply|forward|kick on 0x7ffef7334ab0 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.097+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -95 (95) Operation not supported) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc0098d0 con 0x5611a139e080 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f0103400640 20 client.4713 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f0103400640 10 client.4713 insert_trace from 2024-03-23T23:58:16.098513+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f0103400640 10 client.4713 insert_trace -- no trace 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f0103400640 20 client.4713 handle_client_reply signalling caller 0x7ffef7334ab0 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f0103400640 20 client.4713 handle_client_reply awaiting kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:16.103 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 sendrecv kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 lat 0.000550 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 check_dummy_op result=-95 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 2 client.4713 unmount 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 2 client.4713 unmounting 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 _ll_drop_pins 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 _ll_put 0x7f00d000a000 0x1 1 -> 0 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:16.104 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 nothing to flush 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 flush_caps_sync 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 trim_cache size 0 max 16384 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 8 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 15 client.4713 remove_cap last one, closing snaprealm 0x7f00d0009f10 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 20 client.4713 put_snap_realm 0x1 0x7f00d0009f10 1 -> 0 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 10 client.4713 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 2 client.4713 _close_mds_session mds.0 seq 0 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a127ab70 con 0x5611a139e080 2024-03-23T23:58:16.105 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.098+0000 7f010c985480 2 client.4713 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a127ab70 con 0x5611a139e080 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 10 client.4713 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 5 client.4713 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 1 -- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 10 client.4713 remove_session_caps mds.0 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 10 client.4713 kick_requests_closed for mds.0 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 10 client.4713 unmounting: trim pass, size was 0+0 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 20 client.4713 trim_cache size 0 max 16384 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f0103400640 10 client.4713 unmounting: trim pass, size still 0+0 2024-03-23T23:58:16.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 2 client.4713 unmounted. 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 client.4713 shutdown 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 msgr2=0x5611a12758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a12758a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5611a13a92a0 tx=0x5611a13b1450 comp rx=0 tx=0).stop 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 shutdown_connections 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a12758a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 --2- 172.21.15.31:0/721221773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 >> 172.21.15.31:0/721221773 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 shutdown_connections 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 1 -- 172.21.15.31:0/721221773 wait complete. 2024-03-23T23:58:16.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.102+0000 7f010c985480 20 client.4713 trim_cache size 0 max 16384 2024-03-23T23:58:16.109 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.CheckDummyOP (18 ms) 2024-03-23T23:58:16.109 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.CheckUnknownSessionOp 2024-03-23T23:58:16.111 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.103+0000 7f010c985480 1 -- start start 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.104+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.104+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.104+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.104+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.104+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0007430 con 0x5611a139db40 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.104+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a9170 con 0x5611a12466d0 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.104+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127df40 con 0x5611a1232360 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.105+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.105+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33544/0 (socket says 172.21.15.31:33544) 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.105+0000 7f0103e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.105+0000 7f010a600640 1 -- 172.21.15.31:0/824014188 learned_addr learned my addr 172.21.15.31:0/824014188 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.105+0000 7f0109c00640 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.112 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010a600640 1 -- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010a600640 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010a600640 1 -- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 msgr2=0x5611a1247e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010a600640 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a1247e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010a600640 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1306620 con 0x5611a139db40 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010a600640 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a5470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0104002080 tx=0x7f0104059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e233782db97ce16 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104053070 con 0x5611a139db40 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0104024480 con 0x5611a139db40 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010c985480 10 client.4716 Subscribing to map 'mdsmap' 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.106+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a127b450 con 0x5611a139db40 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f00fb400640 20 client.4716 tick 2024-03-23T23:58:16.113 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f00fb400640 20 client.4716 collect_and_send_metrics 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f00fb400640 20 client.4716 collect_and_send_global_metrics 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f00fb400640 5 client.4716 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f00fb400640 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f00fb400640 20 client.4716 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104063030 con 0x5611a139db40 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f050 con 0x5611a139db40 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f0102000640 1 client.4716 handle_mds_map epoch 8 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f010c985480 20 client.4716 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f010c985480 10 client.4716 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f010c985480 20 client.4716 mds is 0 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f010c985480 10 client.4716 _open_mds_session mds.0 2024-03-23T23:58:16.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f010c985480 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:16.115 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a124d0a0 con 0x5611a139e080 2024-03-23T23:58:16.115 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.107+0000 7f010c985480 10 client.4716 waiting for session to mds.0 to open 2024-03-23T23:58:16.115 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.108+0000 7f0109c00640 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:16.115 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.108+0000 7f0109c00640 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8b4635072fa558b server_cookie=82b4ad3e3ce31f89 in_seq=0 out_seq=0 2024-03-23T23:58:16.115 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.108+0000 7f0102000640 10 client.4716 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:16.115 INFO:tasks.ceph.mds.b.smithi059.stderr:2024-03-23T23:58:16.114+0000 7fe94de00640 -1 mds.0.server Server received unknown message 22, closing session and blocklisting the client 4716 2024-03-23T23:58:16.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a124d0a0 con 0x5611a139e080 2024-03-23T23:58:16.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f0102000640 10 client.4716 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:16.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f0102000640 10 client.4716 renew_caps mds.0 2024-03-23T23:58:16.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0008be0 con 0x5611a139e080 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f0102000640 10 client.4716 connect_mds_targets for mds.0 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 10 client.4716 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 20 client.4716 mds is 0 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 10 client.4716 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 20 client.4716 encode_cap_releases enter (req: 0x5611a1302150, mds: 0) 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 20 client.4716 send_request set sent_stamp to 2024-03-23T23:58:16.113746+0000 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 10 client.4716 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.108492+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:16.108492+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f4330 con 0x5611a139e080 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.112+0000 7f010c985480 20 client.4716 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.113+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0008be0 con 0x5611a139e080 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.113+0000 7f0102000640 10 client.4716 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:16.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc0092a0 con 0x5611a139e080 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 insert_trace from 2024-03-23T23:58:16.113746+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 features 0xffffffffffffffff 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 update_snap_trace len 70 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 get_snap_realm 0x1 0x7f00d0008e00, nref now is 1 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 15 client.4716 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 15 client.4716 snapc 1=[] 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:16.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 put_snap_realm 0x1 0x7f00d0008e00 2 -> 1 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 hrm is_target=1 is_dentry=0 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d0009f10) - ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 dir hash is 2 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 12 client.4716 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 12 client.4716 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) caps pAsLsXsFs 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 get_snap_realm 0x1 0x7f00d0008e00, nref was 1 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 get_snap_realm 0x1 0x7f00d0008e00, nref now is 2 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 15 client.4716 add_update_cap first one, opened snaprealm 0x7f00d0008e00 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 add_update_cap calling signal_caps_inode 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 put_snap_realm 0x1 0x7f00d0008e00 2 -> 1 2024-03-23T23:58:16.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f010c985480 20 client.4716 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f010c985480 20 client.4716 lat 0.001520 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f010c985480 20 client.4716 _ll_get 0x7f00d0009f10 0x1 -> 1 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(???) v7 -- 0x5611a1278220 con 0x5611a139e080 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f010c985480 10 send_unknown_session_op result=0 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_session(reject) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1278220 con 0x5611a139e080 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 handle_client_session client_session(reject) v1 from mds.0 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 -1 client.4716 mds.0 rejected us (unknown error) 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 5 client.4716 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:16.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a13130d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 remove_session_caps mds.0 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 15 client.4716 remove_cap last one, closing snaprealm 0x7f00d0008e00 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 put_snap_realm 0x1 0x7f00d0008e00 1 -> 0 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 remove_session_caps calling signal_caps_inode 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:16.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:16.114+0000 7f0102000640 10 client.4716 kick_requests_closed for mds.0 2024-03-23T23:58:17.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 20 client.4716 tick 2024-03-23T23:58:17.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 10 client.4716 renew_caps() 2024-03-23T23:58:17.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 15 client.4716 renew_caps requesting from mds.0 2024-03-23T23:58:17.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 10 client.4716 renew_caps mds.0 2024-03-23T23:58:17.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 2) v7 -- 0x7f00f00054f0 con 0x5611a139e080 2024-03-23T23:58:17.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 20 client.4716 collect_and_send_metrics 2024-03-23T23:58:17.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 20 client.4716 collect_and_send_global_metrics 2024-03-23T23:58:17.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 5 client.4716 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-03-23T23:58:17.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 10 client.4716 _put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 3 2024-03-23T23:58:17.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:17.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:17.107+0000 7f00fb400640 20 client.4716 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:18.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:18.108+0000 7f00fb400640 20 client.4716 tick 2024-03-23T23:58:18.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:18.108+0000 7f00fb400640 20 client.4716 collect_and_send_metrics 2024-03-23T23:58:18.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:18.108+0000 7f00fb400640 20 client.4716 collect_and_send_global_metrics 2024-03-23T23:58:18.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:18.108+0000 7f00fb400640 5 client.4716 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-03-23T23:58:18.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:18.108+0000 7f00fb400640 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:18.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:18.108+0000 7f00fb400640 20 client.4716 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:19.107 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:19.108+0000 7f00fb400640 20 client.4716 tick 2024-03-23T23:58:19.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:19.108+0000 7f00fb400640 20 client.4716 collect_and_send_metrics 2024-03-23T23:58:19.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:19.108+0000 7f00fb400640 20 client.4716 collect_and_send_global_metrics 2024-03-23T23:58:19.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:19.108+0000 7f00fb400640 5 client.4716 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-03-23T23:58:19.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:19.108+0000 7f00fb400640 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:19.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:19.108+0000 7f00fb400640 20 client.4716 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:20.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:20.108+0000 7f00fb400640 20 client.4716 tick 2024-03-23T23:58:20.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:20.108+0000 7f00fb400640 20 client.4716 collect_and_send_metrics 2024-03-23T23:58:20.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:20.108+0000 7f00fb400640 20 client.4716 collect_and_send_global_metrics 2024-03-23T23:58:20.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:20.108+0000 7f00fb400640 5 client.4716 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-03-23T23:58:20.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:20.108+0000 7f00fb400640 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:20.108 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:20.108+0000 7f00fb400640 20 client.4716 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.110 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.109+0000 7f00fb400640 20 client.4716 tick 2024-03-23T23:58:21.110 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.109+0000 7f00fb400640 20 client.4716 collect_and_send_metrics 2024-03-23T23:58:21.110 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.109+0000 7f00fb400640 20 client.4716 collect_and_send_global_metrics 2024-03-23T23:58:21.110 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.109+0000 7f00fb400640 5 client.4716 collect_and_send_global_metrics: no session with rank=0 -- not sending metric 2024-03-23T23:58:21.110 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.109+0000 7f00fb400640 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:21.110 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.109+0000 7f00fb400640 20 client.4716 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.115+0000 7f010c985480 20 check_client_blocklisted: waiting for latest osdmap 2024-03-23T23:58:21.114 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.115+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x5611a12f4330 con 0x5611a139db40 2024-03-23T23:58:21.115 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.115+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mon.0 v2:172.21.15.31:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0104024e60 con 0x5611a139db40 2024-03-23T23:58:21.115 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.115+0000 7f010b000640 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=24}) v3 -- 0x7f00e40034c0 con 0x5611a139db40 2024-03-23T23:58:21.116 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 <== mon.0 v2:172.21.15.31:3300/0 6 ==== osd_map(24..24 src has 1..24) v4 ==== 331+0+0 (secure 0 0 0) 0x7f0104024b50 con 0x5611a139db40 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 check_client_blocklisted: got latest osdmap: system:0 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 2 client.4716 unmount 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 2 client.4716 unmounting 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=4 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=4 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 10 client.4716 _ll_drop_pins 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 client.4716 _ll_put 0x7f00d0009f10 0x1 1 -> 0 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 client.4716 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.117 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 10 client.4716 flush_caps_sync 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 10 client.4716 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 10 client.4716 _put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) n = 5 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 10 client.4716 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 2 client.4716 unmounted. 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f010c985480 1 client.4716 shutdown 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f0102000640 -1 client.4716 I was blocklisted at osd epoch 24 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.116+0000 7f0102000640 1 -- 172.21.15.31:0/824014188 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=25}) v3 -- 0x7f00d0008270 con 0x5611a139db40 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.118 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a5470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0104002080 tx=0x7f0104059000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 shutdown_connections 2024-03-23T23:58:21.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a5470 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 --2- 172.21.15.31:0/824014188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.119 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 >> 172.21.15.31:0/824014188 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.117+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 shutdown_connections 2024-03-23T23:58:21.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.118+0000 7f010c985480 1 -- 172.21.15.31:0/824014188 wait complete. 2024-03-23T23:58:21.120 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.118+0000 7f010c985480 20 client.4716 trim_cache size 0 max 16384 2024-03-23T23:58:21.120 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.CheckUnknownSessionOp (5015 ms) 2024-03-23T23:58:21.120 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.CheckZeroReclaimFlag 2024-03-23T23:58:21.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.119+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.120+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.121 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.120+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.120+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.120+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.120+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0005eb0 con 0x5611a139db40 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.120+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1278220 con 0x5611a1232360 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.120+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a124c850 con 0x5611a12466d0 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.121+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.121+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33546/0 (socket says 172.21.15.31:33546) 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.121+0000 7f010a600640 1 -- 172.21.15.31:0/3185548793 learned_addr learned my addr 172.21.15.31:0/3185548793 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.121+0000 7f0109c00640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.121+0000 7f0103e00640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010a600640 1 -- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 msgr2=0x5611a13130d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010a600640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.122 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010a600640 1 -- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.123 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010a600640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.123 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010a600640 1 -- 172.21.15.31:0/3185548793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a124c680 con 0x5611a139db40 2024-03-23T23:58:21.124 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010a600640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a1247e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f010405c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21504d6fb90d321 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.124 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.124 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104053040 con 0x5611a139db40 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0104017a00 con 0x5611a139db40 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010c985480 10 client.4719 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.122+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a12f4b50 con 0x5611a139db40 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f00faa00640 20 client.4719 tick 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f00faa00640 20 client.4719 collect_and_send_metrics 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f00faa00640 20 client.4719 collect_and_send_global_metrics 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f00faa00640 5 client.4719 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f00faa00640 20 client.4719 trim_cache size 0 max 16384 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f00faa00640 20 client.4719 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010403dc20 con 0x5611a139db40 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f070 con 0x5611a139db40 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f0103400640 1 client.4719 handle_mds_map epoch 8 2024-03-23T23:58:21.125 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f010c985480 20 client.4719 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f010c985480 10 client.4719 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f010c985480 20 client.4719 mds is 0 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f010c985480 10 client.4719 _open_mds_session mds.0 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f010c985480 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1249e70 con 0x5611a139e080 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.123+0000 7f010c985480 10 client.4719 waiting for session to mds.0 to open 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.124+0000 7f0109c00640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.124+0000 7f0109c00640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a5470 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f87a5b2a734be3 server_cookie=71fa294b75734f7b in_seq=0 out_seq=0 2024-03-23T23:58:21.126 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.124+0000 7f0103400640 10 client.4719 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x7f00fc009040 con 0x5611a139e080 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 renew_caps mds.0 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0009f10 con 0x5611a139e080 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 connect_mds_targets for mds.0 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 10 client.4719 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 20 client.4719 mds is 0 2024-03-23T23:58:21.129 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 10 client.4719 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.130 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 20 client.4719 encode_cap_releases enter (req: 0x5611a124c680, mds: 0) 2024-03-23T23:58:21.130 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 20 client.4719 send_request set sent_stamp to 2024-03-23T23:58:21.130373+0000 2024-03-23T23:58:21.130 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 10 client.4719 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.124346+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.130 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.124346+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f4330 con 0x5611a139e080 2024-03-23T23:58:21.130 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 20 client.4719 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.130 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0009f10 con 0x5611a139e080 2024-03-23T23:58:21.130 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc009ae0 con 0x5611a139e080 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 insert_trace from 2024-03-23T23:58:21.130373+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 features 0xffffffffffffffff 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 update_snap_trace len 70 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 get_snap_realm 0x1 0x7f00d000a130, nref now is 1 2024-03-23T23:58:21.132 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 15 client.4719 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 15 client.4719 snapc 1=[] 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 put_snap_realm 0x1 0x7f00d000a130 2 -> 1 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a220) - ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 dir hash is 2 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 12 client.4719 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 12 client.4719 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d000a220) caps pAsLsXsFs 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 get_snap_realm 0x1 0x7f00d000a130, nref was 1 2024-03-23T23:58:21.133 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 get_snap_realm 0x1 0x7f00d000a130, nref now is 2 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 15 client.4719 add_update_cap first one, opened snaprealm 0x7f00d000a130 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 10 client.4719 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 put_snap_realm 0x1 0x7f00d000a130 2 -> 1 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 20 client.4719 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 20 client.4719 lat 0.001544 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 20 client.4719 _ll_get 0x7f00d000a220 0x1 -> 1 2024-03-23T23:58:21.134 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_reclaim(unknownreclaimflag:ae1c flags 0x0) v1 -- 0x5611a1249e70 con 0x5611a139e080 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.130+0000 7f0103400640 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reclaim_reply(-22 e 0) v1 ==== 13+0+0 (crc 0 0 0) 0x7f00fc057080 con 0x5611a139e080 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f0103400640 10 client.4719 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) v1 from mds.0 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 2 client.4719 unmount 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 2 client.4719 unmounting 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.135 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 _ll_drop_pins 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 _ll_put 0x7f00d000a220 0x1 1 -> 0 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 nothing to flush 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 1 2024-03-23T23:58:21.136 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 flush_caps_sync 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 trim_cache size 0 max 16384 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) n = 8 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a220) 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 15 client.4719 remove_cap last one, closing snaprealm 0x7f00d000a130 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 20 client.4719 put_snap_realm 0x1 0x7f00d000a130 1 -> 0 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 10 client.4719 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d000a220) 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 2 client.4719 _close_mds_session mds.0 seq 0 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a12f44e0 con 0x5611a139e080 2024-03-23T23:58:21.137 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.131+0000 7f010c985480 2 client.4719 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.138 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12f44e0 con 0x5611a139e080 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 10 client.4719 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 5 client.4719 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 1 -- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a13a5470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a5470 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 10 client.4719 remove_session_caps mds.0 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 10 client.4719 kick_requests_closed for mds.0 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 10 client.4719 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 20 client.4719 trim_cache size 0 max 16384 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f0103400640 10 client.4719 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 2 client.4719 unmounted. 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 client.4719 shutdown 2024-03-23T23:58:21.139 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 msgr2=0x5611a1247e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a1247e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f010405c000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 shutdown_connections 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a5470 unknown :-1 s=CLOSED pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12466d0 0x5611a13130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 --2- 172.21.15.31:0/3185548793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a12758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 >> 172.21.15.31:0/3185548793 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 shutdown_connections 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 -- 172.21.15.31:0/3185548793 wait complete. 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 20 client.4719 trim_cache size 0 max 16384 2024-03-23T23:58:21.140 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.CheckZeroReclaimFlag (18 ms) 2024-03-23T23:58:21.141 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.CheckUnknownReclaimFlag 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.136+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.137+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.137+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.137+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0004940 con 0x5611a12466d0 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a127da00 con 0x5611a139db40 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a1245cb0 con 0x5611a1232360 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.143 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33548/0 (socket says 172.21.15.31:33548) 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f0103e00640 1 -- 172.21.15.31:0/2297576006 learned_addr learned my addr 172.21.15.31:0/2297576006 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f0109c00640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.138+0000 7f010a600640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0103e00640 1 -- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 msgr2=0x5611a1247e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0103e00640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0103e00640 1 -- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 msgr2=0x5611a12f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0103e00640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0103e00640 1 -- 172.21.15.31:0/2297576006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13019d0 con 0x5611a12466d0 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f010a600640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0103e00640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a5470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00f4001eb0 tx=0x7f00f4057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f4b33e46772fe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f40529e0 con 0x5611a12466d0 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f00f4052b80 con 0x5611a12466d0 2024-03-23T23:58:21.144 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f010c985480 10 client.4722 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.139+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a13a20d0 con 0x5611a12466d0 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f00fb400640 20 client.4722 tick 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f00fb400640 20 client.4722 collect_and_send_metrics 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f00fb400640 20 client.4722 collect_and_send_global_metrics 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f00fb400640 5 client.4722 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f00fb400640 20 client.4722 trim_cache size 0 max 16384 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f00fb400640 20 client.4722 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f404aba0 con 0x5611a12466d0 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00f4094040 con 0x5611a12466d0 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f0102000640 1 client.4722 handle_mds_map epoch 8 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f010c985480 20 client.4722 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f010c985480 10 client.4722 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f010c985480 20 client.4722 mds is 0 2024-03-23T23:58:21.145 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f010c985480 10 client.4722 _open_mds_session mds.0 2024-03-23T23:58:21.146 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f010c985480 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.146 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13b5040 con 0x5611a139e080 2024-03-23T23:58:21.146 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.140+0000 7f010c985480 10 client.4722 waiting for session to mds.0 to open 2024-03-23T23:58:21.146 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.141+0000 7f0109c00640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.146 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.141+0000 7f0109c00640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14265d8074f01ef7 server_cookie=cdae97a2cc13a196 in_seq=0 out_seq=0 2024-03-23T23:58:21.146 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.141+0000 7f0102000640 10 client.4722 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.148 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x7f00fc009040 con 0x5611a139e080 2024-03-23T23:58:21.148 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f0102000640 10 client.4722 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.148 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f0102000640 10 client.4722 renew_caps mds.0 2024-03-23T23:58:21.148 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0009b90 con 0x5611a139e080 2024-03-23T23:58:21.148 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f0102000640 10 client.4722 connect_mds_targets for mds.0 2024-03-23T23:58:21.148 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 10 client.4722 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.148 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 20 client.4722 mds is 0 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 10 client.4722 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 20 client.4722 encode_cap_releases enter (req: 0x5611a1278020, mds: 0) 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 20 client.4722 send_request set sent_stamp to 2024-03-23T23:58:21.146815+0000 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 10 client.4722 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.141393+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.141393+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f5580 con 0x5611a139e080 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.145+0000 7f010c985480 20 client.4722 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.146+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0009b90 con 0x5611a139e080 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.146+0000 7f0102000640 10 client.4722 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00b4a0 con 0x5611a139e080 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 insert_trace from 2024-03-23T23:58:21.146815+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 features 0xffffffffffffffff 2024-03-23T23:58:21.149 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 update_snap_trace len 70 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 get_snap_realm 0x1 0x7f00d0009f10, nref now is 1 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 15 client.4722 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 15 client.4722 snapc 1=[] 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 put_snap_realm 0x1 0x7f00d0009f10 2 -> 1 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a000) - ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 dir hash is 2 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 12 client.4722 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-03-23T23:58:21.150 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 12 client.4722 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d000a000) caps pAsLsXsFs 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 get_snap_realm 0x1 0x7f00d0009f10, nref was 1 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 get_snap_realm 0x1 0x7f00d0009f10, nref now is 2 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 15 client.4722 add_update_cap first one, opened snaprealm 0x7f00d0009f10 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 put_snap_realm 0x1 0x7f00d0009f10 2 -> 1 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 lat 0.001392 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 _ll_get 0x7f00d000a000 0x1 -> 1 2024-03-23T23:58:21.151 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_reclaim(unknownreclaimflag:ae1c flags 0x2) v1 -- 0x5611a13b5040 con 0x5611a139e080 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reclaim_reply(-22 e 0) v1 ==== 13+0+0 (crc 0 0 0) 0x7f00fc057040 con 0x5611a139e080 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f0102000640 10 client.4722 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) v1 from mds.0 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 2 client.4722 unmount 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 2 client.4722 unmounting 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 _ll_drop_pins 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 _ll_put 0x7f00d000a000 0x1 1 -> 0 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.152 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 nothing to flush 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 1 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 flush_caps_sync 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 trim_cache size 0 max 16384 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) n = 8 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 15 client.4722 remove_cap last one, closing snaprealm 0x7f00d0009f10 2024-03-23T23:58:21.153 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 20 client.4722 put_snap_realm 0x1 0x7f00d0009f10 1 -> 0 2024-03-23T23:58:21.154 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 10 client.4722 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d000a000) 2024-03-23T23:58:21.154 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 2 client.4722 _close_mds_session mds.0 seq 0 2024-03-23T23:58:21.154 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a12f5730 con 0x5611a139e080 2024-03-23T23:58:21.154 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.147+0000 7f010c985480 2 client.4722 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.155 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12f5730 con 0x5611a139e080 2024-03-23T23:58:21.155 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 10 client.4722 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.155 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 5 client.4722 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 1 -- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a13130d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 10 client.4722 remove_session_caps mds.0 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 10 client.4722 kick_requests_closed for mds.0 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 10 client.4722 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 20 client.4722 trim_cache size 0 max 16384 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f0102000640 10 client.4722 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 2 client.4722 unmounted. 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 client.4722 shutdown 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a5470 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f00f4001eb0 tx=0x7f00f4057000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 shutdown_connections 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13130d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.156 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12466d0 0x5611a13a5470 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 --2- 172.21.15.31:0/2297576006 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 >> 172.21.15.31:0/2297576006 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.151+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 shutdown_connections 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.152+0000 7f010c985480 1 -- 172.21.15.31:0/2297576006 wait complete. 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.152+0000 7f010c985480 20 client.4722 trim_cache size 0 max 16384 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.CheckUnknownReclaimFlag (16 ms) 2024-03-23T23:58:21.157 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.CheckNegativeReclaimFlagUnmasked 2024-03-23T23:58:21.159 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.152+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.159 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.153+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.159 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.153+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.159 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.153+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.159 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.153+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.159 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.153+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0005ec0 con 0x5611a139e080 2024-03-23T23:58:21.159 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.153+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a127df40 con 0x5611a139db40 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.153+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a8620 con 0x5611a1232360 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33556/0 (socket says 172.21.15.31:33556) 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 -- 172.21.15.31:0/2033941395 learned_addr learned my addr 172.21.15.31:0/2033941395 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f0103e00640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f0109c00640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 -- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 -- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 msgr2=0x5611a12f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.160 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.154+0000 7f010a600640 1 -- 172.21.15.31:0/2033941395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a4a00 con 0x5611a139e080 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010a600640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a1247e20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f0104034050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b2a2a7f6e2be6a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104053040 con 0x5611a139e080 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f010403d620 con 0x5611a139e080 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 10 client.4725 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a13a2fc0 con 0x5611a139e080 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f00faa00640 20 client.4725 tick 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f00faa00640 20 client.4725 collect_and_send_metrics 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f00faa00640 20 client.4725 collect_and_send_global_metrics 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f00faa00640 5 client.4725 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f00faa00640 20 client.4725 trim_cache size 0 max 16384 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f00faa00640 20 client.4725 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.161 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010405c060 con 0x5611a139e080 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f0104024480 con 0x5611a139e080 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f0103400640 1 client.4725 handle_mds_map epoch 8 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 20 client.4725 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 10 client.4725 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 20 client.4725 mds is 0 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 10 client.4725 _open_mds_session mds.0 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1278020 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127ab70 con 0x5611a1278020 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.155+0000 7f010c985480 10 client.4725 waiting for session to mds.0 to open 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.156+0000 7f0109c00640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1278020 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.157+0000 7f0109c00640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1278020 0x5611a13a7dd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c89e846d1e114b server_cookie=6b65847ffe278368 in_seq=0 out_seq=0 2024-03-23T23:58:21.162 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.157+0000 7f0103400640 10 client.4725 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.164 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127ab70 con 0x5611a1278020 2024-03-23T23:58:21.164 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f0103400640 10 client.4725 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.164 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f0103400640 10 client.4725 renew_caps mds.0 2024-03-23T23:58:21.164 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0004330 con 0x5611a1278020 2024-03-23T23:58:21.164 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f0103400640 10 client.4725 connect_mds_targets for mds.0 2024-03-23T23:58:21.164 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 10 client.4725 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.164 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 20 client.4725 mds is 0 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 10 client.4725 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 20 client.4725 encode_cap_releases enter (req: 0x5611a12f56d0, mds: 0) 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 20 client.4725 send_request set sent_stamp to 2024-03-23T23:58:21.162641+0000 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 10 client.4725 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.156753+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.156753+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13130d0 con 0x5611a1278020 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f010c985480 20 client.4725 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00fc009040 con 0x5611a1278020 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.161+0000 7f0103400640 10 client.4725 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc0010e0 con 0x5611a1278020 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 insert_trace from 2024-03-23T23:58:21.162641+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 features 0xffffffffffffffff 2024-03-23T23:58:21.165 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 update_snap_trace len 70 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 get_snap_realm 0x1 0x7f00d0004330, nref now is 1 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 15 client.4725 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 15 client.4725 snapc 1=[] 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 put_snap_realm 0x1 0x7f00d0004330 2 -> 1 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.166 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d0009f10) - ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 dir hash is 2 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 12 client.4725 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 12 client.4725 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) caps pAsLsXsFs 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 get_snap_realm 0x1 0x7f00d0004330, nref was 1 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 get_snap_realm 0x1 0x7f00d0004330, nref now is 2 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 15 client.4725 add_update_cap first one, opened snaprealm 0x7f00d0004330 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.167 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 put_snap_realm 0x1 0x7f00d0004330 2 -> 1 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 lat 0.001489 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 _ll_get 0x7f00d0009f10 0x1 -> 1 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_reclaim(unknownreclaimflag:ae1c flags 0x7fffffff) v1 -- 0x5611a13130d0 con 0x5611a1278020 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reclaim_reply(-22 e 0) v1 ==== 13+0+0 (crc 0 0 0) 0x7f00fc057040 con 0x5611a1278020 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f0103400640 10 client.4725 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) v1 from mds.0 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 2 client.4725 unmount 2024-03-23T23:58:21.168 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 2 client.4725 unmounting 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 _ll_drop_pins 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 _ll_put 0x7f00d0009f10 0x1 1 -> 0 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.169 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 nothing to flush 2024-03-23T23:58:21.170 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.170 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.170 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 flush_caps_sync 2024-03-23T23:58:21.170 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.170 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 trim_cache size 0 max 16384 2024-03-23T23:58:21.170 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 8 2024-03-23T23:58:21.170 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.171 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 15 client.4725 remove_cap last one, closing snaprealm 0x7f00d0004330 2024-03-23T23:58:21.171 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 20 client.4725 put_snap_realm 0x1 0x7f00d0004330 1 -> 0 2024-03-23T23:58:21.171 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 10 client.4725 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.171 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 2 client.4725 _close_mds_session mds.0 seq 0 2024-03-23T23:58:21.171 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a1313430 con 0x5611a1278020 2024-03-23T23:58:21.171 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.163+0000 7f010c985480 2 client.4725 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.172 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1313430 con 0x5611a1278020 2024-03-23T23:58:21.172 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 10 client.4725 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.172 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 5 client.4725 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:21.172 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 1 -- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1278020 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.172 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1278020 0x5611a13a7dd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.172 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 10 client.4725 remove_session_caps mds.0 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 10 client.4725 kick_requests_closed for mds.0 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 10 client.4725 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 20 client.4725 trim_cache size 0 max 16384 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f0103400640 10 client.4725 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 2 client.4725 unmounted. 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 client.4725 shutdown 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 msgr2=0x5611a1247e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a1247e20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f010400d640 tx=0x7f0104034050 comp rx=0 tx=0).stop 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 shutdown_connections 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a1278020 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a12f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 --2- 172.21.15.31:0/2033941395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.173 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 >> 172.21.15.31:0/2033941395 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.174 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 shutdown_connections 2024-03-23T23:58:21.174 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.167+0000 7f010c985480 1 -- 172.21.15.31:0/2033941395 wait complete. 2024-03-23T23:58:21.174 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.168+0000 7f010c985480 20 client.4725 trim_cache size 0 max 16384 2024-03-23T23:58:21.174 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.CheckNegativeReclaimFlagUnmasked (16 ms) 2024-03-23T23:58:21.174 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.CheckNegativeReclaimFlag 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.169+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.170+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.170+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.170+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.170+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.170+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0009410 con 0x5611a139db40 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.170+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a124dfc0 con 0x5611a1232360 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.170+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a1c00 con 0x5611a1278020 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33566/0 (socket says 172.21.15.31:33566) 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 -- 172.21.15.31:0/3465313478 learned_addr learned my addr 172.21.15.31:0/3465313478 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.177 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f0109c00640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f0103e00640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 -- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 msgr2=0x5611a1247e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 -- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 -- 172.21.15.31:0/3465313478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a12f4b50 con 0x5611a139db40 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f0103e00640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010c985480 10 client.4728 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a13a08a0 con 0x5611a139db40 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f00fb400640 20 client.4728 tick 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f0102000640 10 client.4728 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f00fb400640 20 client.4728 collect_and_send_metrics 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f00fb400640 20 client.4728 collect_and_send_global_metrics 2024-03-23T23:58:21.178 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f00fb400640 5 client.4728 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f00fb400640 20 client.4728 trim_cache size 0 max 16384 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f010a600640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5611a127a4d0 tx=0x7f010401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f536defdf6151d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.171+0000 7f00fb400640 20 client.4728 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104053040 con 0x5611a139db40 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0104024b50 con 0x5611a139db40 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f0104024d50 con 0x5611a139db40 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f0102000640 1 client.4728 handle_mds_map epoch 8 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f010c985480 20 client.4728 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f010c985480 10 client.4728 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f010c985480 20 client.4728 mds is 0 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f010c985480 10 client.4728 _open_mds_session mds.0 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f010c985480 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127ab70 con 0x5611a139e080 2024-03-23T23:58:21.179 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.172+0000 7f010c985480 10 client.4728 waiting for session to mds.0 to open 2024-03-23T23:58:21.180 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.173+0000 7f0109c00640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.180 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.174+0000 7f0109c00640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb085f73d946c092 server_cookie=7884c02744b585c9 in_seq=0 out_seq=0 2024-03-23T23:58:21.180 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.174+0000 7f0102000640 10 client.4728 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127ab70 con 0x5611a139e080 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f0102000640 10 client.4728 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f0102000640 10 client.4728 renew_caps mds.0 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d8009a60 con 0x5611a139e080 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f0102000640 10 client.4728 connect_mds_targets for mds.0 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 10 client.4728 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 20 client.4728 mds is 0 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 10 client.4728 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 20 client.4728 encode_cap_releases enter (req: 0x5611a1313280, mds: 0) 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 20 client.4728 send_request set sent_stamp to 2024-03-23T23:58:21.178825+0000 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 10 client.4728 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.173594+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.173594+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12408a0 con 0x5611a139e080 2024-03-23T23:58:21.186 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.177+0000 7f010c985480 20 client.4728 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00fc009040 con 0x5611a139e080 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00b4a0 con 0x5611a139e080 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 insert_trace from 2024-03-23T23:58:21.178825+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 features 0xffffffffffffffff 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 update_snap_trace len 70 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 get_snap_realm 0x1 0x7f00d8008fd0, nref now is 1 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 15 client.4728 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 15 client.4728 snapc 1=[] 2024-03-23T23:58:21.187 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 put_snap_realm 0x1 0x7f00d8008fd0 2 -> 1 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d8009a10) - ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 dir hash is 2 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 12 client.4728 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 12 client.4728 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d8009a10) caps pAsLsXsFs 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 get_snap_realm 0x1 0x7f00d8008fd0, nref was 1 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 get_snap_realm 0x1 0x7f00d8008fd0, nref now is 2 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 15 client.4728 add_update_cap first one, opened snaprealm 0x7f00d8008fd0 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 10 client.4728 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 put_snap_realm 0x1 0x7f00d8008fd0 2 -> 1 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.188 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f010c985480 20 client.4728 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f010c985480 20 client.4728 lat 0.000892 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f010c985480 20 client.4728 _ll_get 0x7f00d8009a10 0x1 -> 1 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f0102000640 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.178+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_reclaim(unknownreclaimflag:ae1c flags 0xffffffff) v1 -- 0x5611a12f4b50 con 0x5611a139e080 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reclaim_reply(-22 e 0) v1 ==== 13+0+0 (crc 0 0 0) 0x7f00fc057040 con 0x5611a139e080 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f0102000640 10 client.4728 handle_client_reclaim_reply client_reclaim_reply(-22 e 0) v1 from mds.0 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 2 client.4728 unmount 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 2 client.4728 unmounting 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 _ll_drop_pins 2024-03-23T23:58:21.189 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 _ll_put 0x7f00d8009a10 0x1 1 -> 0 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 _release 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 _flush 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 nothing to flush 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 1 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 flush_caps_sync 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 trim_cache size 0 max 16384 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 _put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) n = 8 2024-03-23T23:58:21.190 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d8009a10) 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 15 client.4728 remove_cap last one, closing snaprealm 0x7f00d8008fd0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 20 client.4728 put_snap_realm 0x1 0x7f00d8008fd0 1 -> 0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 10 client.4728 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d8009a10) 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 2 client.4728 _close_mds_session mds.0 seq 0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a12408a0 con 0x5611a139e080 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.179+0000 7f010c985480 2 client.4728 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12408a0 con 0x5611a139e080 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 10 client.4728 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 5 client.4728 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 1 -- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 10 client.4728 remove_session_caps mds.0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 10 client.4728 kick_requests_closed for mds.0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 10 client.4728 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.191 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 20 client.4728 trim_cache size 0 max 16384 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f0102000640 10 client.4728 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 2 client.4728 unmounted. 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 client.4728 shutdown 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 msgr2=0x5611a13a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x5611a127a4d0 tx=0x7f010401f000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 shutdown_connections 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 --2- 172.21.15.31:0/3465313478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.183+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 >> 172.21.15.31:0/3465313478 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.184+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 shutdown_connections 2024-03-23T23:58:21.192 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.184+0000 7f010c985480 1 -- 172.21.15.31:0/3465313478 wait complete. 2024-03-23T23:58:21.193 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.184+0000 7f010c985480 20 client.4728 trim_cache size 0 max 16384 2024-03-23T23:58:21.193 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.CheckNegativeReclaimFlag (16 ms) 2024-03-23T23:58:21.193 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameRemount 2024-03-23T23:58:21.199 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.185+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.187+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80083b0 con 0x5611a1278020 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a2d50 con 0x5611a1232360 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127da00 con 0x5611a139db40 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f0103e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33578/0 (socket says 172.21.15.31:33578) 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f0103e00640 1 -- 172.21.15.31:0/1587683291 learned_addr learned my addr 172.21.15.31:0/1587683291 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.200 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.188+0000 7f010a600640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0109c00640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103e00640 1 -- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 msgr2=0x5611a13a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103e00640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103e00640 1 -- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 msgr2=0x5611a1247e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103e00640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103e00640 1 -- 172.21.15.31:0/1587683291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a2fc0 con 0x5611a1278020 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0109c00640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103e00640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1278020 0x5611a13a5470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f00f40030a0 tx=0x7f00f4061070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe950043d65eec9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f010c985480 10 client.4731 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4057040 con 0x5611a1278020 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a1306620 con 0x5611a1278020 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.189+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f00f4066940 con 0x5611a1278020 2024-03-23T23:58:21.201 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f00faa00640 20 client.4731 tick 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f00faa00640 20 client.4731 collect_and_send_metrics 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f00faa00640 20 client.4731 collect_and_send_global_metrics 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f00faa00640 5 client.4731 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f00faa00640 20 client.4731 trim_cache size 0 max 16384 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f00faa00640 20 client.4731 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00f4094070 con 0x5611a1278020 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f0103400640 1 client.4731 handle_mds_map epoch 8 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f010c985480 20 client.4731 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f010c985480 10 client.4731 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.202 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f010c985480 20 client.4731 mds is 0 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f010c985480 10 client.4731 _open_mds_session mds.0 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f010c985480 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1279740 con 0x5611a139e080 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.190+0000 7f010c985480 10 client.4731 waiting for session to mds.0 to open 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.191+0000 7f0109c00640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.191+0000 7f0109c00640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b65836d6599265bc server_cookie=92b99c3ee49dc942 in_seq=0 out_seq=0 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.191+0000 7f0103400640 10 client.4731 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1279740 con 0x5611a139e080 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f0103400640 10 client.4731 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f0103400640 10 client.4731 renew_caps mds.0 2024-03-23T23:58:21.203 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d8009f60 con 0x5611a139e080 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f0103400640 10 client.4731 connect_mds_targets for mds.0 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 10 client.4731 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 20 client.4731 mds is 0 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 10 client.4731 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 20 client.4731 encode_cap_releases enter (req: 0x5611a127ab70, mds: 0) 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 20 client.4731 send_request set sent_stamp to 2024-03-23T23:58:21.196654+0000 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 10 client.4731 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.191301+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.191301+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13133a0 con 0x5611a139e080 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f010c985480 20 client.4731 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d8009f60 con 0x5611a139e080 2024-03-23T23:58:21.204 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.195+0000 7f0103400640 10 client.4731 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc009990 con 0x5611a139e080 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 insert_trace from 2024-03-23T23:58:21.196654+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 features 0xffffffffffffffff 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 update_snap_trace len 70 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0x7f00d800a180, nref now is 1 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 15 client.4731 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 15 client.4731 snapc 1=[] 2024-03-23T23:58:21.205 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 put_snap_realm 0x1 0x7f00d800a180 2 -> 1 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d800a270) - ctime 2024-03-23T23:58:16.068363+0000 mtime 2024-03-23T23:58:16.068363+0000 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 dir hash is 2 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 12 client.4731 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 15 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 12 client.4731 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=- has_dir_layout 0x7f00d800a270) caps pAsLsXsFs 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0x7f00d800a180, nref was 1 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0x7f00d800a180, nref now is 2 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 15 client.4731 add_update_cap first one, opened snaprealm 0x7f00d800a180 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 10 client.4731 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.206 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 put_snap_realm 0x1 0x7f00d800a180 2 -> 1 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 lat 0.000976 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 _ll_get 0x7f00d800a270 0x1 -> 1 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 10 client.4731 mkdirat: AlternateNameRemount_44572 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f0103400640 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 10 client.4731 path_walk 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.207 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 may_create 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 10 client.4731 _getattr mask As issued=1 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 3 client.4731 may_create 0x7f00d800a270 = 0 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 8 client.4731 _mkdir(0x1 AlternateNameRemount_44572, 0777, uid 0, gid 0) 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 get_or_create 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) name AlternateNameRemount_44572 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 15 open_dir 0x5611a12fa5a0 on 0x7f00d800a270 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 15 client.4731 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 'AlternateNameRemount_44572' dn 0x1.head["AlternateNameRemount_44572"] (new dn) 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 10 client.4731 _mkdir: making request 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 choose_target_mds inode dir hash is 2 on AlternateNameRemount_44572 => 281763846 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 choose_target_mds 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) is_hash=1 hash=281763846 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 10 client.4731 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 mds is 0 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 10 client.4731 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.208 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 encode_cap_releases enter (req: 0x5611a13133a0, mds: 0) 2024-03-23T23:58:21.209 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 encode_dentry_release enter(dn:0x7f00d0009e20) 2024-03-23T23:58:21.209 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270), req:0x5611a13133a0 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.209 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 send_request set sent_stamp to 2024-03-23T23:58:21.197919+0000 2024-03-23T23:58:21.209 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 10 client.4731 send_request client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameRemount_44572 (foo) 2024-03-23T23:58:21.197825+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.209 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameRemount_44572 (foo) 2024-03-23T23:58:21.197825+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12409c0 con 0x5611a139e080 2024-03-23T23:58:21.209 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.196+0000 7f010c985480 20 client.4731 awaiting reply|forward|kick on 0x7ffef73346a0 2024-03-23T23:58:21.216 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 832+0+0 (crc 0 0 0) 0x7f00fc00fba0 con 0x5611a139e080 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 insert_trace from 2024-03-23T23:58:21.197919+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 features 0xffffffffffffffff 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 update_snap_trace len 70 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0x7f00d800a180, nref was 1 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0x7f00d800a180, nref now is 2 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 update_inode_file_time 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d800a850) - ctime 2024-03-23T23:58:21.197825+0000 mtime 2024-03-23T23:58:21.197825+0000 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 dir hash is 2 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 12 client.4731 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 12 client.4731 add_update_inode adding 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=- 0x7f00d800a850) caps pAsxLsXsxFsx 2024-03-23T23:58:21.217 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0x7f00d800a180, nref was 2 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 get_snap_realm 0x1 0x7f00d800a180, nref now is 3 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 15 client.4731 add_update_cap first one, opened snaprealm 0x7f00d800a180 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 add_update_cap issued - -> pAsxLsXsxFsx from mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f00d800a850) 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f00d800a850) 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 12 client.4731 add_update_inode had 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a270) caps pAsLsXsFs 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 update_inode_file_time 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:16.068363+0000 ctime=2024-03-23T23:58:16.068363+0000 change_attr=15 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a270) pAsLsXs ctime 2024-03-23T23:58:21.197825+0000 mtime 2024-03-23T23:58:21.197825+0000 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 dir hash is 2 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 12 client.4731 add_update_inode client inode change_attr: 15 , mds inodestat change_attr: 16 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 10 client.4731 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.218 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 12 client.4731 insert_dentry_inode 'AlternateNameRemount_44572' vino 0x10000000008.head in dir 0x1.head dn 0x7f00d0009e20 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 15 client.4731 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 'AlternateNameRemount_44572' to inode 0x7f00d800a850 dn 0x1.head["AlternateNameRemount_44572"] (old dn) 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) n = 1 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 link inode 0x7f00d800a850 parents now 0x1.head["AlternateNameRemount_44572"] 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) n = 1 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 15 client.4731 update_dentry_lease 0x1.head["AlternateNameRemount_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.197919+0000 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 put_snap_realm 0x1 0x7f00d800a180 3 -> 2 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 handle_client_reply signalling caller 0x7ffef73346a0 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 handle_client_reply awaiting kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 sendrecv kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 lat 0.006473 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _mkdir result is 0 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 trim_cache size 1 max 16384 2024-03-23T23:58:21.219 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 8 client.4731 _mkdir(#0x1/AlternateNameRemount_44572, 040777) = 0 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 put_inode on 0x10000000008.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f0103400640 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 2 client.4731 unmount 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 2 client.4731 unmounting 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _ll_drop_pins 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 _ll_put 0x7f00d800a270 0x1 1 -> 0 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.220 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 _release 0x10000000008.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _invalidate_inode_cache 0x10000000008.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _flush 0x10000000008.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 nothing to flush 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x10000000008.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) n = 1 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 _release 0x1.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _flush 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 nothing to flush 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x10000000008.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a850) n = 1 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 flush_caps_sync 2024-03-23T23:58:21.221 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 trim_cache size 1 max 16384 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 15 client.4731 trim_dentry unlinking dn AlternateNameRemount_44572 in dir 0x1 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 15 client.4731 unlink dir 0x7f00d800a270 'AlternateNameRemount_44572' dn 0x7f00d0009e20 inode 0x7f00d800a850 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f00d800a850) n = 1 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 unlink inode 0x7f00d800a850 parents now 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 15 client.4731 unlink removing 'AlternateNameRemount_44572' dn 0x7f00d0009e20 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 15 client.4731 close_dir dir 0x5611a12fa5a0 on 0x7f00d800a270 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 1 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f00d800a850) n = 1 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) n = 14 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.222 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 15 client.4731 remove_cap last one, closing snaprealm 0x7f00d800a180 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 20 client.4731 put_snap_realm 0x1 0x7f00d800a180 2 -> 1 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.203+0000 7f010c985480 10 client.4731 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=- has_dir_layout 0x7f00d800a270) 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 10 client.4731 _put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f00d800a850) n = 7 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 10 client.4731 remove_cap mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE 0x7f00d800a850) 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 15 client.4731 remove_cap last one, closing snaprealm 0x7f00d800a180 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 20 client.4731 put_snap_realm 0x1 0x7f00d800a180 1 -> 0 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 10 client.4731 _put_inode deleting 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=- COMPLETE 0x7f00d800a850) 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 2 client.4731 _close_mds_session mds.0 seq 0 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close) v7 -- 0x5611a1240b70 con 0x5611a139e080 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.204+0000 7f010c985480 2 client.4731 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1240b70 con 0x5611a139e080 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 10 client.4731 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.223 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 5 client.4731 _closed_mds_session mds.0 seq 0 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 1 -- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 10 client.4731 remove_session_caps mds.0 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 10 client.4731 kick_requests_closed for mds.0 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 10 client.4731 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 20 client.4731 trim_cache size 0 max 16384 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f0103400640 10 client.4731 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f010c985480 2 client.4731 unmounted. 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.208+0000 7f010c985480 1 client.4731 shutdown 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1278020 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1278020 0x5611a13a5470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f00f40030a0 tx=0x7f00f4061070 comp rx=0 tx=0).stop 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 shutdown_connections 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.224 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 --2- 172.21.15.31:0/1587683291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 >> 172.21.15.31:0/1587683291 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 shutdown_connections 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 1 -- 172.21.15.31:0/1587683291 wait complete. 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.209+0000 7f010c985480 20 client.4731 trim_cache size 0 max 16384 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.211+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.212+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.213+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.213+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.213+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.213+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8004f10 con 0x5611a139db40 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.213+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1231d00 con 0x5611a1232360 2024-03-23T23:58:21.225 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.213+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127b8a0 con 0x5611a1278020 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33584/0 (socket says 172.21.15.31:33584) 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 -- 172.21.15.31:0/3510980573 learned_addr learned my addr 172.21.15.31:0/3510980573 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f0109c00640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f0103e00640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 -- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 -- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 msgr2=0x5611a13a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a08a0 con 0x5611a139db40 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.214+0000 7f010a600640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0104005ca0 tx=0x7f010404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dd9cacc33e99c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104053070 con 0x5611a139db40 2024-03-23T23:58:21.226 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 10 client.4734 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0104017640 con 0x5611a139db40 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a13019d0 con 0x5611a139db40 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f00fb400640 20 client.4734 tick 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f00fb400640 20 client.4734 collect_and_send_metrics 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f00fb400640 20 client.4734 collect_and_send_global_metrics 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f00fb400640 5 client.4734 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f00fb400640 20 client.4734 trim_cache size 0 max 16384 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f00fb400640 20 client.4734 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a139db40 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f0102000640 1 client.4734 handle_mds_map epoch 8 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 20 client.4734 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 10 client.4734 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 20 client.4734 mds is 0 2024-03-23T23:58:21.227 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 10 client.4734 _open_mds_session mds.0 2024-03-23T23:58:21.228 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.228 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13b5910 con 0x5611a139e080 2024-03-23T23:58:21.228 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.215+0000 7f010c985480 10 client.4734 waiting for session to mds.0 to open 2024-03-23T23:58:21.228 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.216+0000 7f0109c00640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.228 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.217+0000 7f0109c00640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59a9eb53de8c6b8 server_cookie=26b9630f8f483c00 in_seq=0 out_seq=0 2024-03-23T23:58:21.228 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.217+0000 7f0102000640 10 client.4734 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.232 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a13b5910 con 0x5611a139e080 2024-03-23T23:58:21.232 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f0102000640 10 client.4734 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.232 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f0102000640 10 client.4734 renew_caps mds.0 2024-03-23T23:58:21.232 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d8009fe0 con 0x5611a139e080 2024-03-23T23:58:21.232 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f0102000640 10 client.4734 connect_mds_targets for mds.0 2024-03-23T23:58:21.232 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 10 client.4734 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.232 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 20 client.4734 mds is 0 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 10 client.4734 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 20 client.4734 encode_cap_releases enter (req: 0x5611a127ab70, mds: 0) 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 20 client.4734 send_request set sent_stamp to 2024-03-23T23:58:21.222083+0000 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 10 client.4734 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.216782+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.216782+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12408a0 con 0x5611a139e080 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f010c985480 20 client.4734 awaiting reply|forward|kick on 0x7ffef7334840 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d8009fe0 con 0x5611a139e080 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.221+0000 7f0102000640 10 client.4734 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc009850 con 0x5611a139e080 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 insert_trace from 2024-03-23T23:58:21.222083+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 features 0xffffffffffffffff 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 update_snap_trace len 70 2024-03-23T23:58:21.233 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref now is 1 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 15 client.4734 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 15 client.4734 snapc 1=[] 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 put_snap_realm 0x1 0x7f00d800a200 2 -> 1 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d800a2f0) - ctime 2024-03-23T23:58:21.197825+0000 mtime 2024-03-23T23:58:21.197825+0000 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 dir hash is 2 2024-03-23T23:58:21.234 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 12 client.4734 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 16 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 12 client.4734 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=- has_dir_layout 0x7f00d800a2f0) caps pAsLsXsFs 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref was 1 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref now is 2 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 15 client.4734 add_update_cap first one, opened snaprealm 0x7f00d800a200 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 10 client.4734 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 put_snap_realm 0x1 0x7f00d800a200 2 -> 1 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 handle_client_reply signalling caller 0x7ffef7334840 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 lat 0.001549 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 _ll_get 0x7f00d800a2f0 0x1 -> 1 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 walk: AlternateNameRemount_44572 2024-03-23T23:58:21.235 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 path_walk cur=0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 path_walk AlternateNameRemount_44572 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 0 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) AlternateNameRemount_44572 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 (path is AlternateNameRemount_44572) 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 may_lookup 0x1.head(faked_ino=0 nref=7 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 _getattr mask As issued=1 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 3 client.4734 may_lookup 0x7f00d800a2f0 = 0 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 _do_lookup on #0x1/AlternateNameRemount_44572 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 choose_target_mds inode dir hash is 2 on AlternateNameRemount_44572 => 281763846 2024-03-23T23:58:21.236 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 choose_target_mds 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) is_hash=1 hash=281763846 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 mds is 0 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 encode_cap_releases enter (req: 0x5611a12408a0, mds: 0) 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 send_request set sent_stamp to 2024-03-23T23:58:21.223684+0000 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 10 client.4734 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRemount_44572 2024-03-23T23:58:21.223666+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRemount_44572 2024-03-23T23:58:21.223666+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1240bf0 con 0x5611a139e080 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f010c985480 20 client.4734 awaiting reply|forward|kick on 0x7ffef73344c0 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.222+0000 7f0102000640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success) v1 ==== 832+0+0 (crc 0 0 0) 0x7f00fc00fba0 con 0x5611a139e080 2024-03-23T23:58:21.237 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 insert_trace from 2024-03-23T23:58:21.223684+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 features 0xffffffffffffffff 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 update_snap_trace len 70 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref was 1 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref now is 2 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 update_inode_file_time 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d800a8d0) - ctime 2024-03-23T23:58:21.197825+0000 mtime 2024-03-23T23:58:21.197825+0000 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 dir hash is 2 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 12 client.4734 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 12 client.4734 add_update_inode adding 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=- 0x7f00d800a8d0) caps pAsLsXsFs 2024-03-23T23:58:21.238 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref was 2 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref now is 3 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 15 client.4734 add_update_cap first one, opened snaprealm 0x7f00d800a200 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) 0x7f00d800a8d0) 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) 0x7f00d800a8d0) 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 12 client.4734 add_update_inode had 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) caps pAsLsXsFs 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 dir hash is 2 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 12 client.4734 add_update_inode client inode change_attr: 16 , mds inodestat change_attr: 16 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 10 client.4734 add_update_cap issued pAsLsXsFs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=8 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.239 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 15 open_dir 0x7f00d8009780 on 0x7f00d800a2f0 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 12 client.4734 insert_dentry_inode 'AlternateNameRemount_44572' vino 0x10000000008.head in dir 0x1.head dn 0 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 15 client.4734 link dir 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 'AlternateNameRemount_44572' to inode 0x10000000008.head(faked_ino=0 nref=2 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE 0x7f00d800a8d0) dn 0x1.head["AlternateNameRemount_44572"] (new dn) 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 link inode 0x7f00d800a8d0 parents now 0x1.head["AlternateNameRemount_44572"] 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 15 client.4734 update_dentry_lease 0x1.head["AlternateNameRemount_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.223684+0000 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 put_snap_realm 0x1 0x7f00d800a200 3 -> 2 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 handle_client_reply signalling caller 0x7ffef73344c0 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 make_request target is 0x10000000008.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) 2024-03-23T23:58:21.240 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 lat 0.001820 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 _do_lookup res is 0 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 _lookup have 0x1.head["AlternateNameRemount_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 _lookup 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) AlternateNameRemount_44572 = 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=9 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f0102000640 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 path_walk cur=0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 path_walk 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.241 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 may_delete 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0); ; name AlternateNameRemount_44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 _getattr mask As issued=1 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 3 client.4734 may_delete 0x7f00d800a2f0 = 0 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 8 client.4734 _rmdir(0x1 AlternateNameRemount_44572 uid 0 gid 0) 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 get_or_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) name AlternateNameRemount_44572 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 _lookup have 0x1.head["AlternateNameRemount_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 _lookup 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) AlternateNameRemount_44572 = 0x10000000008.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0) 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 choose_target_mds inode dir hash is 2 on AlternateNameRemount_44572 => 281763846 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 choose_target_mds 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0) is_hash=1 hash=281763846 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 mds is 0 2024-03-23T23:58:21.242 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 encode_cap_releases enter (req: 0x5611a1240bf0, mds: 0) 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 encode_inode_release enter(in:0x10000000008.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameRemount_44572"] 0x7f00d800a8d0), req:0x5611a1240bf0 mds:0, drop:Lsx, unless:-, force:0) 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 encode_dentry_release enter(dn:0x7f00d800aeb0) 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d800a2f0), req:0x5611a1240bf0 mds:0, drop:XxFs, unless:Fx, force:1) 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 send_request set sent_stamp to 2024-03-23T23:58:21.225610+0000 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 10 client.4734 send_request client_request(unknown.0:3 rmdir #0x1/AlternateNameRemount_44572 2024-03-23T23:58:21.225587+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 rmdir #0x1/AlternateNameRemount_44572 2024-03-23T23:58:21.225587+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276330 con 0x5611a139e080 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.224+0000 7f010c985480 20 client.4734 awaiting reply|forward|kick on 0x7ffef73347e0 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success unsafe) v1 ==== 498+0+0 (crc 0 0 0) 0x7f00fc023690 con 0x5611a139e080 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 handle_client_reply got a reply. Safe:0 tid 3 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 insert_trace from 2024-03-23T23:58:21.225610+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 features 0xffffffffffffffff 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 update_snap_trace len 70 2024-03-23T23:58:21.243 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref was 2 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 get_snap_realm 0x1 0x7f00d800a200, nref now is 3 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 hrm is_target=0 is_dentry=1 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 12 client.4734 add_update_inode had 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) caps pAsLsXs 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 update_inode_file_time 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=16 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) pAsLsXs ctime 2024-03-23T23:58:21.225587+0000 mtime 2024-03-23T23:58:21.225587+0000 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 dir hash is 2 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 12 client.4734 add_update_inode client inode change_attr: 16 , mds inodestat change_attr: 17 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 15 client.4734 unlink dir 0x7f00d800a2f0 'AlternateNameRemount_44572' dn 0x7f00d800aeb0 inode 0x7f00d800a8d0 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 unlink inode 0x7f00d800a8d0 parents now 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.244 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 put_snap_realm 0x1 0x7f00d800a200 3 -> 2 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 handle_client_reply signalling caller 0x7ffef73347e0 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 20 client.4734 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 20 client.4734 lat 0.005699 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 20 client.4734 trim_cache size 1 max 16384 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 8 client.4734 rmdir(#0x1/AlternateNameRemount_44572) = 0 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 2 client.4734 unmount 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 2 client.4734 unmounting 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a1276330 con 0x5611a139e080 2024-03-23T23:58:21.245 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 10 client.4734 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.246 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.246 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 20 client.4734 trim_cache size 1 max 16384 2024-03-23T23:58:21.246 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f0102000640 10 client.4734 unmounting: trim pass, size still 1+2 2024-03-23T23:58:21.246 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.230+0000 7f010c985480 10 client.4734 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.247 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(grant ino 0x10000000008 27 seq 2 caps=pAsLsXsFsx dirty=- wanted=Ls follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.197825+0000 ctime 2024-03-23T23:58:21.225587+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a139e080 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 5 client.4734 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 mds.0 seq now 1 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 5 client.4734 handle_cap_grant on in 0x10000000008 mds.0 seq 2 caps now pAsLsXsFsx was pAsXsFs 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 update_inode_file_time 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.197825+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d800a8d0) pAsXsFs ctime 2024-03-23T23:58:21.225587+0000 mtime 2024-03-23T23:58:21.197825+0000 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 grant, new caps are LsFx 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 5 client.4734 _try_to_trim_inode in 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 20 client.4734 trim_cache size 1 max 16384 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 unmounting: trim pass, size still 1+2 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc023af0 con 0x5611a139e080 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 20 client.4734 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 insert_trace from 2024-03-23T23:58:21.225610+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.248 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 5 client.4734 _try_to_trim_inode in 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 20 client.4734 trim_cache size 1 max 16384 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 15 client.4734 trim_dentry unlinking dn AlternateNameRemount_44572 in dir 0x1 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 15 client.4734 unlink dir 0x7f00d800a2f0 'AlternateNameRemount_44572' dn 0x7f00d800aeb0 inode 0 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 15 client.4734 unlink removing 'AlternateNameRemount_44572' dn 0x7f00d800aeb0 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 15 client.4734 close_dir dir 0x7f00d8009780 on 0x7f00d800a2f0 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f0102000640 10 client.4734 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.249 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _ll_drop_pins 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 _ll_put 0x7f00d800a2f0 0x1 1 -> 0 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 _release 0x10000000008.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _invalidate_inode_cache 0x10000000008.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _flush 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 nothing to flush 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 _release 0x1.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.250 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _flush 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 nothing to flush 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) n = 1 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 1 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 flush_caps_sync 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 trim_cache size 0 max 16384 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) n = 16 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 15 client.4734 remove_cap last one, closing snaprealm 0x7f00d800a200 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_snap_realm 0x1 0x7f00d800a200 2 -> 1 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=- has_dir_layout 0x7f00d800a2f0) 2024-03-23T23:58:21.251 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _put_inode on 0x10000000008.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) n = 12 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 remove_cap mds.0 on 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d800a8d0) 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 15 client.4734 remove_cap last one, closing snaprealm 0x7f00d800a200 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 20 client.4734 put_snap_realm 0x1 0x7f00d800a200 1 -> 0 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 10 client.4734 _put_inode deleting 0x10000000008.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.197825+0000 mtime=2024-03-23T23:58:21.197825+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=1 caps=- COMPLETE 0x7f00d800a8d0) 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 2 client.4734 _close_mds_session mds.0 seq 1 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 1) v7 -- 0x5611a1276870 con 0x5611a139e080 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.237+0000 7f010c985480 2 client.4734 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.241+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a1276330 con 0x5611a139e080 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.241+0000 7f0102000640 10 client.4734 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.241+0000 7f0102000640 5 client.4734 _closed_mds_session mds.0 seq 1 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.241+0000 7f0102000640 1 -- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a1247e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.241+0000 7f0102000640 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f0102000640 10 client.4734 remove_session_caps mds.0 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f0102000640 10 client.4734 kick_requests_closed for mds.0 2024-03-23T23:58:21.252 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f0102000640 10 client.4734 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f0102000640 20 client.4734 trim_cache size 0 max 16384 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f0102000640 10 client.4734 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 2 client.4734 unmounted. 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 client.4734 shutdown 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 msgr2=0x5611a13a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0104005ca0 tx=0x7f010404e000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 shutdown_connections 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=CLOSED pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 --2- 172.21.15.31:0/3510980573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 >> 172.21.15.31:0/3510980573 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 shutdown_connections 2024-03-23T23:58:21.253 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 1 -- 172.21.15.31:0/3510980573 wait complete. 2024-03-23T23:58:21.254 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.242+0000 7f010c985480 20 client.4734 trim_cache size 0 max 16384 2024-03-23T23:58:21.254 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.AlternateNameRemount (59 ms) 2024-03-23T23:58:21.254 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameMkdir 2024-03-23T23:58:21.258 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.243+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.258 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.244+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.258 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.258 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.258 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.258 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8008950 con 0x5611a1232360 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a12fa710 con 0x5611a139db40 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127df40 con 0x5611a1278020 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33598/0 (socket says 172.21.15.31:33598) 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.245+0000 7f0109c00640 1 -- 172.21.15.31:0/1606505783 learned_addr learned my addr 172.21.15.31:0/1606505783 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f010a600640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0103e00640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0109c00640 1 -- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 msgr2=0x5611a1247e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0109c00640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0109c00640 1 -- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 msgr2=0x5611a13a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0109c00640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0109c00640 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a1279650 con 0x5611a1232360 2024-03-23T23:58:21.259 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f010a600640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0103e00640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f010c985480 10 client.4737 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a13b26f0 con 0x5611a1232360 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f00faa00640 20 client.4737 tick 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f00faa00640 20 client.4737 collect_and_send_metrics 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f00faa00640 20 client.4737 collect_and_send_global_metrics 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f00faa00640 5 client.4737 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f00faa00640 20 client.4737 trim_cache size 0 max 16384 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f00faa00640 20 client.4737 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0109c00640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a13a5470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00bf60 tx=0x5611a127ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74274343aac6bb66 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.246+0000 7f0103400640 10 client.4737 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc06a060 con 0x5611a1232360 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f00fc009850 con 0x5611a1232360 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc04c040 con 0x5611a1232360 2024-03-23T23:58:21.260 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f0103400640 1 client.4737 handle_mds_map epoch 8 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f010c985480 20 client.4737 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f010c985480 10 client.4737 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f010c985480 20 client.4737 mds is 0 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f010c985480 10 client.4737 _open_mds_session mds.0 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f010c985480 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1276330 con 0x5611a139e080 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.247+0000 7f010c985480 10 client.4737 waiting for session to mds.0 to open 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.248+0000 7f0103e00640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.249+0000 7f0103e00640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bf0a21656810e60 server_cookie=7fc22a9bc9eff063 in_seq=0 out_seq=0 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.249+0000 7f0103400640 10 client.4737 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1276330 con 0x5611a139e080 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f0103400640 10 client.4737 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.261 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f0103400640 10 client.4737 renew_caps mds.0 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0006200 con 0x5611a139e080 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f0103400640 10 client.4737 connect_mds_targets for mds.0 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 10 client.4737 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 20 client.4737 mds is 0 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 10 client.4737 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 20 client.4737 encode_cap_releases enter (req: 0x5611a127ab70, mds: 0) 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 20 client.4737 send_request set sent_stamp to 2024-03-23T23:58:21.254389+0000 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 10 client.4737 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.248412+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.248412+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12408a0 con 0x5611a139e080 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f010c985480 20 client.4737 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0006200 con 0x5611a139e080 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.253+0000 7f0103400640 10 client.4737 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f4019a30 con 0x5611a139e080 2024-03-23T23:58:21.262 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 insert_trace from 2024-03-23T23:58:21.254389+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 features 0xffffffffffffffff 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 update_snap_trace len 70 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref now is 1 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 15 client.4737 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 15 client.4737 snapc 1=[] 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 put_snap_realm 0x1 0x7f00d0006420 2 -> 1 2024-03-23T23:58:21.263 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d0009f10) - ctime 2024-03-23T23:58:21.225587+0000 mtime 2024-03-23T23:58:21.225587+0000 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 dir hash is 2 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 12 client.4737 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 17 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 12 client.4737 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=- has_dir_layout 0x7f00d0009f10) caps pAsLsXsFs 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref was 1 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref now is 2 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 15 client.4737 add_update_cap first one, opened snaprealm 0x7f00d0006420 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 10 client.4737 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 put_snap_realm 0x1 0x7f00d0006420 2 -> 1 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.264 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 lat 0.001981 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 _ll_get 0x7f00d0009f10 0x1 -> 1 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 10 client.4737 mkdirat: AlternateNameMkdir_44572 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f0103400640 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 10 client.4737 path_walk 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 may_create 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 10 client.4737 _getattr mask As issued=1 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 3 client.4737 may_create 0x7f00d0009f10 = 0 2024-03-23T23:58:21.265 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 8 client.4737 _mkdir(0x1 AlternateNameMkdir_44572, 0777, uid 0, gid 0) 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 get_or_create 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) name AlternateNameMkdir_44572 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 15 open_dir 0x5611a13b26f0 on 0x7f00d0009f10 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 15 client.4737 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 'AlternateNameMkdir_44572' dn 0x1.head["AlternateNameMkdir_44572"] (new dn) 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 10 client.4737 _mkdir: making request 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 choose_target_mds inode dir hash is 2 on AlternateNameMkdir_44572 => 3199046728 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 choose_target_mds 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) is_hash=1 hash=3199046728 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 10 client.4737 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 mds is 0 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 10 client.4737 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 encode_cap_releases enter (req: 0x5611a12408a0, mds: 0) 2024-03-23T23:58:21.266 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 encode_dentry_release enter(dn:0x7f00d0009e20) 2024-03-23T23:58:21.267 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10), req:0x5611a12408a0 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.267 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 send_request set sent_stamp to 2024-03-23T23:58:21.256588+0000 2024-03-23T23:58:21.267 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 10 client.4737 send_request client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameMkdir_44572 (foo) 2024-03-23T23:58:21.256537+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.267 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameMkdir_44572 (foo) 2024-03-23T23:58:21.256537+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1240ce0 con 0x5611a139e080 2024-03-23T23:58:21.267 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.255+0000 7f010c985480 20 client.4737 awaiting reply|forward|kick on 0x7ffef73344f0 2024-03-23T23:58:21.269 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 830+0+0 (crc 0 0 0) 0x7f00f4005a40 con 0x5611a139e080 2024-03-23T23:58:21.269 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 20 client.4737 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.269 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 10 client.4737 insert_trace from 2024-03-23T23:58:21.256588+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.269 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 10 client.4737 features 0xffffffffffffffff 2024-03-23T23:58:21.269 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 10 client.4737 update_snap_trace len 70 2024-03-23T23:58:21.269 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref was 1 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref now is 2 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 10 client.4737 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 10 client.4737 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.262+0000 7f0103400640 10 client.4737 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a4f0) - ctime 2024-03-23T23:58:21.256537+0000 mtime 2024-03-23T23:58:21.256537+0000 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 dir hash is 2 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 12 client.4737 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 12 client.4737 add_update_inode adding 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=- 0x7f00d000a4f0) caps pAsxLsXsxFsx 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref was 2 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref now is 3 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 15 client.4737 add_update_cap first one, opened snaprealm 0x7f00d0006420 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 10 client.4737 add_update_cap issued - -> pAsxLsXsxFsx from mds.0 on 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f00d000a4f0) 2024-03-23T23:58:21.270 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 10 client.4737 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 10 client.4737 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f00d000a4f0) 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 12 client.4737 add_update_inode had 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) caps pAsLsXsFs 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 10 client.4737 update_inode_file_time 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.225587+0000 ctime=2024-03-23T23:58:21.225587+0000 change_attr=17 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) pAsLsXs ctime 2024-03-23T23:58:21.256537+0000 mtime 2024-03-23T23:58:21.256537+0000 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 dir hash is 2 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 12 client.4737 add_update_inode client inode change_attr: 17 , mds inodestat change_attr: 18 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 10 client.4737 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 10 client.4737 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 12 client.4737 insert_dentry_inode 'AlternateNameMkdir_44572' vino 0x10000000009.head in dir 0x1.head dn 0x7f00d0009e20 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 15 client.4737 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 'AlternateNameMkdir_44572' to inode 0x7f00d000a4f0 dn 0x1.head["AlternateNameMkdir_44572"] (old dn) 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 link inode 0x7f00d000a4f0 parents now 0x1.head["AlternateNameMkdir_44572"] 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.271 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 15 client.4737 update_dentry_lease 0x1.head["AlternateNameMkdir_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.256588+0000 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 put_snap_realm 0x1 0x7f00d0006420 3 -> 2 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 handle_client_reply signalling caller 0x7ffef73344f0 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 handle_client_reply awaiting kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 sendrecv kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 lat 0.007545 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 _mkdir result is 0 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 trim_cache size 1 max 16384 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 8 client.4737 _mkdir(#0x1/AlternateNameMkdir_44572, 040777) = 0 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.272 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 walk: AlternateNameMkdir_44572 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 path_walk cur=0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 path_walk AlternateNameMkdir_44572 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 0 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) AlternateNameMkdir_44572 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 (path is AlternateNameMkdir_44572) 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 may_lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 _getattr mask As issued=1 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 3 client.4737 may_lookup 0x7f00d0009f10 = 0 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 _lookup have 0x1.head["AlternateNameMkdir_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 _lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) AlternateNameMkdir_44572 = 0x10000000009.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.273 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 path_walk 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 may_delete 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10); ; name AlternateNameMkdir_44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 _getattr mask As issued=1 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 3 client.4737 may_delete 0x7f00d0009f10 = 0 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 8 client.4737 _rmdir(0x1 AlternateNameMkdir_44572 uid 0 gid 0) 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) name AlternateNameMkdir_44572 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 _lookup have 0x1.head["AlternateNameMkdir_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 _lookup 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) AlternateNameMkdir_44572 = 0x10000000009.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) 2024-03-23T23:58:21.274 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.275 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 choose_target_mds inode dir hash is 2 on AlternateNameMkdir_44572 => 3199046728 2024-03-23T23:58:21.275 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 choose_target_mds 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10) is_hash=1 hash=3199046728 2024-03-23T23:58:21.275 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.275 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 mds is 0 2024-03-23T23:58:21.275 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.275 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 encode_cap_releases enter (req: 0x5611a1240ce0, mds: 0) 2024-03-23T23:58:21.275 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 encode_inode_release enter(in:0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0), req:0x5611a1240ce0 mds:0, drop:Lsx, unless:-, force:0) 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 encode_dentry_release enter(dn:0x7f00d0009e20) 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009f10), req:0x5611a1240ce0 mds:0, drop:XxFs, unless:Fx, force:1) 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 send_request set sent_stamp to 2024-03-23T23:58:21.264264+0000 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 10 client.4737 send_request client_request(unknown.0:3 rmdir #0x1/AlternateNameMkdir_44572 2024-03-23T23:58:21.264228+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 rmdir #0x1/AlternateNameMkdir_44572 2024-03-23T23:58:21.264228+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276640 con 0x5611a139e080 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f010c985480 20 client.4737 awaiting reply|forward|kick on 0x7ffef7334630 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxXsxFsx(0=pAsxXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.263+0000 7f0103400640 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.276 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_caps(revoke ino 0x10000000009 1 seq 2 caps=pAsXsFsx dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.256537+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f408b020 con 0x5611a139e080 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 5 client.4737 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 mds.0 seq now 1 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 5 client.4737 handle_cap_grant on in 0x10000000009 mds.0 seq 2 caps now pAsXsFsx was pAsxXsxFsx 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsxXsxFsx(0=pAsxXsxFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) pAsxXsxFsx ctime 2024-03-23T23:58:21.256537+0000 mtime 2024-03-23T23:58:21.256537+0000 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 revocation of AxXx 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 check_caps on 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) wanted AsLsXsFsx used - issued pAsXsFsx revoking AxXx flags=1 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 cap mds.0 issued pAsXsFsx implemented pAsxXsxFsx revoking AxXx 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 completed revocation of AxXx 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 send_cap 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) mds.0 seq 2 used - want AsLsXsFsx flush - retain pAsLsXsFsx held pAsxXsxFsx revoking AxXx dropping - 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 15 client.4737 auth cap, requesting max_size 0 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000009 1 seq 2 caps=pAsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.256537+0000 change_attr 0) v12 -- 0x7f00d0006510 con 0x5611a139e080 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.264+0000 7f0103400640 10 client.4737 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(revoke ino 0x10000000009 1 seq 3 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.256537+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d0006510 con 0x5611a139e080 2024-03-23T23:58:21.277 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 mds.0 seq now 2 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 5 client.4737 handle_cap_grant on in 0x10000000009 mds.0 seq 3 caps now pAsXsFs was pAsXsFsx 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) pAsXsFsx ctime 2024-03-23T23:58:21.256537+0000 mtime 2024-03-23T23:58:21.256537+0000 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 revocation of Fx 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 check_caps on 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) wanted AsLsXsFsx used - issued pAsXsFs revoking Fx flags=1 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 cap mds.0 issued pAsXsFs implemented pAsXsFsx revoking Fx 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 completed revocation of Fx 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 send_cap 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) mds.0 seq 3 used - want AsLsXsFsx flush - retain pAsLsXsFs held pAsXsFsx revoking Fx dropping - 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 15 client.4737 auth cap, requesting max_size 0 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000009 1 seq 3 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.256537+0000 change_attr 0) v12 -- 0x7f00f408b020 con 0x5611a139e080 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.266+0000 7f0103400640 10 client.4737 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.278 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.267+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_caps(grant ino 0x10000000009 1 seq 4 caps=pAsLsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.256537+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f408b020 con 0x5611a139e080 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.267+0000 7f0103400640 10 client.4737 mds.0 seq now 3 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.267+0000 7f0103400640 5 client.4737 handle_cap_grant on in 0x10000000009 mds.0 seq 4 caps now pAsLsXsFs was pAsXsFs 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.267+0000 7f0103400640 10 client.4737 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) pAsXsFs ctime 2024-03-23T23:58:21.256537+0000 mtime 2024-03-23T23:58:21.256537+0000 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.267+0000 7f0103400640 10 client.4737 grant, new caps are Ls 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.267+0000 7f0103400640 10 client.4737 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_caps(revoke ino 0x10000000009 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.256537+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f4052ac0 con 0x5611a139e080 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 mds.0 seq now 4 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 5 client.4737 handle_cap_grant on in 0x10000000009 mds.0 seq 5 caps now pAsXsFs was pAsLsXsFs 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) pAsLsXsFs ctime 2024-03-23T23:58:21.256537+0000 mtime 2024-03-23T23:58:21.256537+0000 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 revocation of Ls 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 check_caps on 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) wanted AsLsXsFsx used - issued pAsXsFs revoking Ls flags=1 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 cap mds.0 issued pAsXsFs implemented pAsLsXsFs revoking Ls 2024-03-23T23:58:21.279 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 completed revocation of Ls 2024-03-23T23:58:21.280 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 send_cap 0x10000000009.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameMkdir_44572"] 0x7f00d000a4f0) mds.0 seq 5 used - want AsLsXsFsx flush - retain pAsXsFsx held pAsLsXsFs revoking Ls dropping - 2024-03-23T23:58:21.280 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 15 client.4737 auth cap, requesting max_size 0 2024-03-23T23:58:21.280 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000009 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.256537+0000 change_attr 0) v12 -- 0x7f00f408b020 con 0x5611a139e080 2024-03-23T23:58:21.280 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.269+0000 7f0103400640 10 client.4737 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.281 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:3 = 0 (0) Success unsafe) v1 ==== 496+0+0 (crc 0 0 0) 0x7f00f406f680 con 0x5611a139e080 2024-03-23T23:58:21.281 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 handle_client_reply got a reply. Safe:0 tid 3 2024-03-23T23:58:21.281 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 insert_trace from 2024-03-23T23:58:21.264264+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:21.281 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 features 0xffffffffffffffff 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 update_snap_trace len 70 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref was 2 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 get_snap_realm 0x1 0x7f00d0006420, nref now is 3 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 hrm is_target=0 is_dentry=1 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 12 client.4737 add_update_inode had 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) caps pAsLsXs 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 update_inode_file_time 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=18 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) pAsLsXs ctime 2024-03-23T23:58:21.264228+0000 mtime 2024-03-23T23:58:21.264228+0000 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 dir hash is 2 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 12 client.4737 add_update_inode client inode change_attr: 18 , mds inodestat change_attr: 19 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 15 client.4737 unlink dir 0x7f00d0009f10 'AlternateNameMkdir_44572' dn 0x7f00d0009e20 inode 0x7f00d000a4f0 2024-03-23T23:58:21.282 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 unlink inode 0x7f00d000a4f0 parents now 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 put_snap_realm 0x1 0x7f00d0006420 3 -> 2 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 handle_client_reply signalling caller 0x7ffef7334630 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 handle_client_reply awaiting kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 20 client.4737 sendrecv kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 20 client.4737 lat 0.009234 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 20 client.4737 trim_cache size 1 max 16384 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 8 client.4737 rmdir(#0x1/AlternateNameMkdir_44572) = 0 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.283 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 2 client.4737 unmount 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 2 client.4737 unmounting 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a1313560 con 0x5611a139e080 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 10 client.4737 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 trim_cache size 1 max 16384 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 unmounting: trim pass, size still 1+2 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f010c985480 10 client.4737 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(grant ino 0x10000000009 1 seq 6 caps=pAsLsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.256537+0000 ctime 2024-03-23T23:58:21.264228+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f408b020 con 0x5611a139e080 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 mds.0 seq now 5 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 5 client.4737 handle_cap_grant on in 0x10000000009 mds.0 seq 6 caps now pAsLsXsFsx was pAsXsFs 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 update_inode_file_time 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.256537+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000a4f0) pAsXsFs ctime 2024-03-23T23:58:21.264228+0000 mtime 2024-03-23T23:58:21.256537+0000 2024-03-23T23:58:21.284 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 grant, new caps are LsFx 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 5 client.4737 _try_to_trim_inode in 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 20 client.4737 trim_cache size 1 max 16384 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.273+0000 7f0103400640 10 client.4737 unmounting: trim pass, size still 1+2 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f406f9e0 con 0x5611a139e080 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 20 client.4737 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 10 client.4737 insert_trace from 2024-03-23T23:58:21.264264+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 10 client.4737 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 5 client.4737 _try_to_trim_inode in 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) 2024-03-23T23:58:21.285 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 10 client.4737 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 20 client.4737 trim_cache size 1 max 16384 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 15 client.4737 trim_dentry unlinking dn AlternateNameMkdir_44572 in dir 0x1 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 15 client.4737 unlink dir 0x7f00d0009f10 'AlternateNameMkdir_44572' dn 0x7f00d0009e20 inode 0 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 15 client.4737 unlink removing 'AlternateNameMkdir_44572' dn 0x7f00d0009e20 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 15 client.4737 close_dir dir 0x5611a13b26f0 on 0x7f00d0009f10 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f0103400640 10 client.4737 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _ll_drop_pins 2024-03-23T23:58:21.286 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 _ll_put 0x7f00d0009f10 0x1 1 -> 0 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 _release 0x10000000009.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _invalidate_inode_cache 0x10000000009.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _flush 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 nothing to flush 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 _release 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _flush 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 nothing to flush 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.287 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) n = 1 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 1 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 flush_caps_sync 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 trim_cache size 0 max 16384 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) n = 20 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 15 client.4737 remove_cap last one, closing snaprealm 0x7f00d0006420 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_snap_realm 0x1 0x7f00d0006420 2 -> 1 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=- has_dir_layout 0x7f00d0009f10) 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _put_inode on 0x10000000009.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) n = 10 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 remove_cap mds.0 on 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000a4f0) 2024-03-23T23:58:21.288 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 15 client.4737 remove_cap last one, closing snaprealm 0x7f00d0006420 2024-03-23T23:58:21.289 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 20 client.4737 put_snap_realm 0x1 0x7f00d0006420 1 -> 0 2024-03-23T23:58:21.289 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 10 client.4737 _put_inode deleting 0x10000000009.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.256537+0000 mtime=2024-03-23T23:58:21.256537+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=1 caps=- COMPLETE 0x7f00d000a4f0) 2024-03-23T23:58:21.289 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 2 client.4737 _close_mds_session mds.0 seq 5 2024-03-23T23:58:21.289 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 5) v7 -- 0x5611a13a09f0 con 0x5611a139e080 2024-03-23T23:58:21.289 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.279+0000 7f010c985480 2 client.4737 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.290 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 <== mds.0 v2:172.21.15.59:6834/3774186650 12 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a13a09f0 con 0x5611a139e080 2024-03-23T23:58:21.290 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 10 client.4737 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.290 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 5 client.4737 _closed_mds_session mds.0 seq 5 2024-03-23T23:58:21.290 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 1 -- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a12f7520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.290 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.290 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 10 client.4737 remove_session_caps mds.0 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 10 client.4737 kick_requests_closed for mds.0 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 10 client.4737 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 20 client.4737 trim_cache size 0 max 16384 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f0103400640 10 client.4737 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 2 client.4737 unmounted. 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 client.4737 shutdown 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 msgr2=0x5611a13a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a13a5470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00bf60 tx=0x5611a127ed90 comp rx=0 tx=0).stop 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 shutdown_connections 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 unknown :-1 s=CLOSED pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a1247e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 --2- 172.21.15.31:0/1606505783 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a13a5470 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.291 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.284+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 >> 172.21.15.31:0/1606505783 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.292 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.285+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 shutdown_connections 2024-03-23T23:58:21.292 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.285+0000 7f010c985480 1 -- 172.21.15.31:0/1606505783 wait complete. 2024-03-23T23:58:21.292 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.285+0000 7f010c985480 20 client.4737 trim_cache size 0 max 16384 2024-03-23T23:58:21.292 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.AlternateNameMkdir (42 ms) 2024-03-23T23:58:21.292 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameLong 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.286+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.288+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.288+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a12f7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0009180 con 0x5611a139db40 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1276330 con 0x5611a1232360 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a124cff0 con 0x5611a1278020 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a12f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.295 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a12f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33600/0 (socket says 172.21.15.31:33600) 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f010a600640 1 -- 172.21.15.31:0/2562859875 learned_addr learned my addr 172.21.15.31:0/2562859875 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f0103e00640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.289+0000 7f0109c00640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.290+0000 7f010a600640 1 -- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.290+0000 7f010a600640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.290+0000 7f010a600640 1 -- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 msgr2=0x5611a13a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.290+0000 7f010a600640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.290+0000 7f010a600640 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13b5960 con 0x5611a139db40 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.291+0000 7f010a600640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a12f7520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0104007040 tx=0x7f010406f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c1697b58e5c8dd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.291+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.291+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043040 con 0x5611a139db40 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.291+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0104017440 con 0x5611a139db40 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.291+0000 7f010c985480 10 client.4740 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.296 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.291+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a13a4a00 con 0x5611a139db40 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f00fb400640 20 client.4740 tick 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f00fb400640 20 client.4740 collect_and_send_metrics 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f00fb400640 20 client.4740 collect_and_send_global_metrics 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f00fb400640 5 client.4740 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f00fb400640 20 client.4740 trim_cache size 0 max 16384 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f00fb400640 20 client.4740 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010405c040 con 0x5611a139db40 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f070 con 0x5611a139db40 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f0102000640 1 client.4740 handle_mds_map epoch 8 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f010c985480 20 client.4740 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f010c985480 10 client.4740 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f010c985480 20 client.4740 mds is 0 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f010c985480 10 client.4740 _open_mds_session mds.0 2024-03-23T23:58:21.297 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f010c985480 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.298 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a13a09f0 con 0x5611a139e080 2024-03-23T23:58:21.298 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.292+0000 7f010c985480 10 client.4740 waiting for session to mds.0 to open 2024-03-23T23:58:21.298 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.293+0000 7f0109c00640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.298 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.293+0000 7f0102000640 10 client.4740 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.298 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.294+0000 7f0109c00640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=308f9c678690ba5 server_cookie=880f126c0acaee53 in_seq=0 out_seq=0 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x7f00fc009040 con 0x5611a139e080 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f0102000640 10 client.4740 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f0102000640 10 client.4740 renew_caps mds.0 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0009d90 con 0x5611a139e080 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f0102000640 10 client.4740 connect_mds_targets for mds.0 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 10 client.4740 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 20 client.4740 mds is 0 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 10 client.4740 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 20 client.4740 encode_cap_releases enter (req: 0x5611a124c940, mds: 0) 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 20 client.4740 send_request set sent_stamp to 2024-03-23T23:58:21.299575+0000 2024-03-23T23:58:21.299 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 10 client.4740 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.293439+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.300 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.293439+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1240bd0 con 0x5611a139e080 2024-03-23T23:58:21.300 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f010c985480 20 client.4740 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.300 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0009d90 con 0x5611a139e080 2024-03-23T23:58:21.300 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.298+0000 7f0102000640 10 client.4740 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.301 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc001890 con 0x5611a139e080 2024-03-23T23:58:21.301 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 insert_trace from 2024-03-23T23:58:21.299575+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 features 0xffffffffffffffff 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 update_snap_trace len 70 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref now is 1 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 15 client.4740 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 15 client.4740 snapc 1=[] 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 put_snap_realm 0x1 0x7f00d0009fb0 2 -> 1 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a0a0) - ctime 2024-03-23T23:58:21.264228+0000 mtime 2024-03-23T23:58:21.264228+0000 2024-03-23T23:58:21.302 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 dir hash is 2 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 12 client.4740 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 19 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 12 client.4740 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=- has_dir_layout 0x7f00d000a0a0) caps pAsLsXsFs 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref was 1 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref now is 2 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 15 client.4740 add_update_cap first one, opened snaprealm 0x7f00d0009fb0 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 10 client.4740 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 put_snap_realm 0x1 0x7f00d0009fb0 2 -> 1 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.303 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 lat 0.001731 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 _ll_get 0x7f00d000a0a0 0x1 -> 1 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 10 client.4740 mkdirat: AlternateNameLong_44572 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f0102000640 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 10 client.4740 path_walk 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 may_create 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 10 client.4740 _getattr mask As issued=1 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 3 client.4740 may_create 0x7f00d000a0a0 = 0 2024-03-23T23:58:21.304 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 8 client.4740 _mkdir(0x1 AlternateNameLong_44572, 0777, uid 0, gid 0) 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 get_or_create 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) name AlternateNameLong_44572 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 15 open_dir 0x5611a13a4a00 on 0x7f00d000a0a0 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 15 client.4740 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 'AlternateNameLong_44572' dn 0x1.head["AlternateNameLong_44572"] (new dn) 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 10 client.4740 _mkdir: making request 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 choose_target_mds inode dir hash is 2 on AlternateNameLong_44572 => 3725306753 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 choose_target_mds 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) is_hash=1 hash=3725306753 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 10 client.4740 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.305 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 mds is 0 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 10 client.4740 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 encode_cap_releases enter (req: 0x5611a1240bd0, mds: 0) 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 encode_dentry_release enter(dn:0x7f00d0006420) 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0), req:0x5611a1240bd0 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 send_request set sent_stamp to 2024-03-23T23:58:21.301440+0000 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 10 client.4740 send_request client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameLong_44572 (--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------) 2024-03-23T23:58:21.301404+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 mkdir owner_uid=0, owner_gid=0 #0x1/AlternateNameLong_44572 (--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------) 2024-03-23T23:58:21.301404+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13b5c80 con 0x5611a139e080 2024-03-23T23:58:21.306 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.300+0000 7f010c985480 20 client.4740 awaiting reply|forward|kick on 0x7ffef73346c0 2024-03-23T23:58:21.310 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.308+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = 0 (0) Success safe) v1 ==== 5946+0+0 (crc 0 0 0) 0x7f00fc00f800 con 0x5611a139e080 2024-03-23T23:58:21.310 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.310 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 insert_trace from 2024-03-23T23:58:21.301440+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 features 0xffffffffffffffff 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 update_snap_trace len 70 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref was 1 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref now is 2 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000ba90) - ctime 2024-03-23T23:58:21.301404+0000 mtime 2024-03-23T23:58:21.301404+0000 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 dir hash is 2 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 12 client.4740 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.311 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 12 client.4740 add_update_inode adding 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=- 0x7f00d000ba90) caps pAsxLsXsxFsx 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref was 2 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref now is 3 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 15 client.4740 add_update_cap first one, opened snaprealm 0x7f00d0009fb0 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 add_update_cap issued - -> pAsxLsXsxFsx from mds.0 on 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f00d000ba90) 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 marking (I_COMPLETE|I_DIR_ORDERED) on empty dir 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) 0x7f00d000ba90) 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 12 client.4740 add_update_inode had 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) caps pAsLsXsFs 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.264228+0000 ctime=2024-03-23T23:58:21.264228+0000 change_attr=19 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) pAsLsXs ctime 2024-03-23T23:58:21.301404+0000 mtime 2024-03-23T23:58:21.301404+0000 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 dir hash is 2 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 12 client.4740 add_update_inode client inode change_attr: 19 , mds inodestat change_attr: 20 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 10 client.4740 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.312 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 12 client.4740 insert_dentry_inode 'AlternateNameLong_44572' vino 0x1000000000a.head in dir 0x1.head dn 0x7f00d0006420 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 15 client.4740 link dir 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 'AlternateNameLong_44572' to inode 0x7f00d000ba90 dn 0x1.head["AlternateNameLong_44572"] (old dn) 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 link inode 0x7f00d000ba90 parents now 0x1.head["AlternateNameLong_44572"] 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 15 client.4740 update_dentry_lease 0x1.head["AlternateNameLong_44572"] lease(mask 0 dur 0 altn -----------------------------------------------------------------------------------------------------------------------------...)) from 2024-03-23T23:58:21.301440+0000 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 put_snap_realm 0x1 0x7f00d0009fb0 3 -> 2 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 handle_client_reply signalling caller 0x7ffef73346c0 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 lat 0.008861 2024-03-23T23:58:21.313 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 _mkdir result is 0 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 trim_cache size 1 max 16384 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 8 client.4740 _mkdir(#0x1/AlternateNameLong_44572, 040777) = 0 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 walk: AlternateNameLong_44572 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f0102000640 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=12 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 path_walk cur=0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 path_walk AlternateNameLong_44572 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 0 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) AlternateNameLong_44572 2024-03-23T23:58:21.314 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 (path is AlternateNameLong_44572) 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 may_lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 _getattr mask As issued=1 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 3 client.4740 may_lookup 0x7f00d000a0a0 = 0 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 _lookup have 0x1.head["AlternateNameLong_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 _lookup 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) AlternateNameLong_44572 = 0x1000000000a.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=13 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 path_walk 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 may_delete 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0); ; name AlternateNameLong_44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 _getattr mask As issued=1 2024-03-23T23:58:21.315 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 3 client.4740 may_delete 0x7f00d000a0a0 = 0 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 8 client.4740 _rmdir(0x1 AlternateNameLong_44572 uid 0 gid 0) 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) name AlternateNameLong_44572 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 _lookup have 0x1.head["AlternateNameLong_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 _lookup 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) AlternateNameLong_44572 = 0x1000000000a.head(faked_ino=0 nref=7 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 choose_target_mds inode dir hash is 2 on AlternateNameLong_44572 => 3725306753 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 choose_target_mds 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0) is_hash=1 hash=3725306753 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 mds is 0 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 encode_cap_releases enter (req: 0x5611a13b5c80, mds: 0) 2024-03-23T23:58:21.316 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 encode_inode_release enter(in:0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxLsXsxFsx(0=pAsxLsXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90), req:0x5611a13b5c80 mds:0, drop:Lsx, unless:-, force:0) 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 encode_dentry_release enter(dn:0x7f00d0006420) 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a0a0), req:0x5611a13b5c80 mds:0, drop:XxFs, unless:Fx, force:1) 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 send_request set sent_stamp to 2024-03-23T23:58:21.310522+0000 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 10 client.4740 send_request client_request(unknown.0:3 rmdir #0x1/AlternateNameLong_44572 2024-03-23T23:58:21.310480+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 rmdir #0x1/AlternateNameLong_44572 2024-03-23T23:58:21.310480+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276640 con 0x5611a139e080 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.309+0000 7f010c985480 20 client.4740 awaiting reply|forward|kick on 0x7ffef7334800 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_caps(revoke ino 0x1000000000a 1 seq 2 caps=pAsXsFsx dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.301404+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a139e080 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 5 client.4740 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 mds.0 seq now 1 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 5 client.4740 handle_cap_grant on in 0x1000000000a mds.0 seq 2 caps now pAsXsFsx was pAsxXsxFsx 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsxXsxFsx(0=pAsxXsxFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) pAsxXsxFsx ctime 2024-03-23T23:58:21.301404+0000 mtime 2024-03-23T23:58:21.301404+0000 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 revocation of AxXx 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 check_caps on 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) wanted AsLsXsFsx used - issued pAsXsFsx revoking AxXx flags=1 2024-03-23T23:58:21.317 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 cap mds.0 issued pAsXsFsx implemented pAsxXsxFsx revoking AxXx 2024-03-23T23:58:21.318 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 completed revocation of AxXx 2024-03-23T23:58:21.318 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 send_cap 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) mds.0 seq 2 used - want AsLsXsFsx flush - retain pAsLsXsFsx held pAsxXsxFsx revoking AxXx dropping - 2024-03-23T23:58:21.318 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 15 client.4740 auth cap, requesting max_size 0 2024-03-23T23:58:21.318 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x1000000000a 1 seq 2 caps=pAsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.301404+0000 change_attr 0) v12 -- 0x7f00d000c180 con 0x5611a139e080 2024-03-23T23:58:21.318 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.310+0000 7f0102000640 10 client.4740 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.319 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(revoke ino 0x1000000000a 1 seq 3 caps=pAsXsFs dirty=- wanted=- follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.301404+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d000c180 con 0x5611a139e080 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 mds.0 seq now 2 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 5 client.4740 handle_cap_grant on in 0x1000000000a mds.0 seq 3 caps now pAsXsFs was pAsXsFsx 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFsx(0=pAsXsFsx) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) pAsXsFsx ctime 2024-03-23T23:58:21.301404+0000 mtime 2024-03-23T23:58:21.301404+0000 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 revocation of Fx 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 check_caps on 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) wanted AsLsXsFsx used - issued pAsXsFs revoking Fx flags=1 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 cap mds.0 issued pAsXsFs implemented pAsXsFsx revoking Fx 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 completed revocation of Fx 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 send_cap 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) mds.0 seq 3 used - want AsLsXsFsx flush - retain pAsLsXsFs held pAsXsFsx revoking Fx dropping - 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 15 client.4740 auth cap, requesting max_size 0 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x1000000000a 1 seq 3 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.301404+0000 change_attr 0) v12 -- 0x7f00fc05a040 con 0x5611a139e080 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.320 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_caps(grant ino 0x1000000000a 1 seq 4 caps=pAsLsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.301404+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a139e080 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 mds.0 seq now 3 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 5 client.4740 handle_cap_grant on in 0x1000000000a mds.0 seq 4 caps now pAsLsXsFs was pAsXsFs 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) pAsXsFs ctime 2024-03-23T23:58:21.301404+0000 mtime 2024-03-23T23:58:21.301404+0000 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 grant, new caps are Ls 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.313+0000 7f0102000640 10 client.4740 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_caps(revoke ino 0x1000000000a 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.301404+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc042040 con 0x5611a139e080 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 mds.0 seq now 4 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 5 client.4740 handle_cap_grant on in 0x1000000000a mds.0 seq 5 caps now pAsXsFs was pAsLsXsFs 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsLsXsFs(0=pAsLsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) pAsLsXsFs ctime 2024-03-23T23:58:21.301404+0000 mtime 2024-03-23T23:58:21.301404+0000 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 revocation of Ls 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 check_caps on 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) wanted AsLsXsFsx used - issued pAsXsFs revoking Ls flags=1 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 cap mds.0 issued pAsXsFs implemented pAsLsXsFs revoking Ls 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 completed revocation of Ls 2024-03-23T23:58:21.321 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 send_cap 0x1000000000a.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE parents=0x1.head["AlternateNameLong_44572"] 0x7f00d000ba90) mds.0 seq 5 used - want AsLsXsFsx flush - retain pAsXsFsx held pAsLsXsFs revoking Ls dropping - 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 15 client.4740 auth cap, requesting max_size 0 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x1000000000a 1 seq 5 caps=pAsXsFs dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.301404+0000 change_attr 0) v12 -- 0x7f00fc05a040 con 0x5611a139e080 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.314+0000 7f0102000640 10 client.4740 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:3 = 0 (0) Success unsafe) v1 ==== 5612+0+0 (crc 0 0 0) 0x7f00fc009850 con 0x5611a139e080 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 handle_client_reply got a reply. Safe:0 tid 3 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 insert_trace from 2024-03-23T23:58:21.310522+0000 mds.0 is_target=0 is_dentry=1 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 features 0xffffffffffffffff 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 update_snap_trace len 70 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref was 2 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 get_snap_realm 0x1 0x7f00d0009fb0, nref now is 3 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.322 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 hrm is_target=0 is_dentry=1 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 12 client.4740 add_update_inode had 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) caps pAsLsXs 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=20 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) pAsLsXs ctime 2024-03-23T23:58:21.310480+0000 mtime 2024-03-23T23:58:21.310480+0000 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 dir hash is 2 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 12 client.4740 add_update_inode client inode change_attr: 20 , mds inodestat change_attr: 21 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 15 client.4740 unlink dir 0x7f00d000a0a0 'AlternateNameLong_44572' dn 0x7f00d0006420 inode 0x7f00d000ba90 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 unlink inode 0x7f00d000ba90 parents now 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 put_snap_realm 0x1 0x7f00d0009fb0 3 -> 2 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 handle_client_reply signalling caller 0x7ffef7334800 2024-03-23T23:58:21.323 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 20 client.4740 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 20 client.4740 lat 0.009444 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 20 client.4740 trim_cache size 1 max 16384 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 8 client.4740 rmdir(#0x1/AlternateNameLong_44572) = 0 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 2 client.4740 unmount 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 2 client.4740 unmounting 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a13a4ce0 con 0x5611a139e080 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(grant ino 0x1000000000a 1 seq 6 caps=pAsLsXsFsx dirty=- wanted=AsLsXsFsx follows 0 size 0/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.301404+0000 ctime 2024-03-23T23:58:21.310480+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a139e080 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f010c985480 10 client.4740 waiting for write request '3' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.324 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 mds.0 seq now 5 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 5 client.4740 handle_cap_grant on in 0x1000000000a mds.0 seq 6 caps now pAsLsXsFsx was pAsXsFs 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 update_inode_file_time 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.301404+0000 change_attr=0 caps=pAsXsFs(0=pAsXsFs) COMPLETE 0x7f00d000ba90) pAsXsFs ctime 2024-03-23T23:58:21.310480+0000 mtime 2024-03-23T23:58:21.301404+0000 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 grant, new caps are LsFx 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 5 client.4740 _try_to_trim_inode in 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 20 client.4740 trim_cache size 1 max 16384 2024-03-23T23:58:21.325 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.319+0000 7f0102000640 10 client.4740 unmounting: trim pass, size still 1+2 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc009bb0 con 0x5611a139e080 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 20 client.4740 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 10 client.4740 insert_trace from 2024-03-23T23:58:21.310522+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 10 client.4740 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 5 client.4740 _try_to_trim_inode in 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 10 client.4740 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 20 client.4740 trim_cache size 1 max 16384 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 15 client.4740 trim_dentry unlinking dn AlternateNameLong_44572 in dir 0x1 2024-03-23T23:58:21.326 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 15 client.4740 unlink dir 0x7f00d000a0a0 'AlternateNameLong_44572' dn 0x7f00d0006420 inode 0 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 15 client.4740 unlink removing 'AlternateNameLong_44572' dn 0x7f00d0006420 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 15 client.4740 close_dir dir 0x5611a13a4a00 on 0x7f00d000a0a0 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f0102000640 10 client.4740 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _ll_drop_pins 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 _ll_put 0x7f00d000a0a0 0x1 1 -> 0 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 _release 0x1000000000a.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _invalidate_inode_cache 0x1000000000a.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _flush 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) 2024-03-23T23:58:21.327 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 nothing to flush 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 _release 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _flush 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 nothing to flush 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) n = 1 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 1 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 flush_caps_sync 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 wait_sync_caps want 1 (last is 1, 0 total flushing) 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 trim_cache size 0 max 16384 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) n = 20 2024-03-23T23:58:21.328 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 15 client.4740 remove_cap last one, closing snaprealm 0x7f00d0009fb0 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_snap_realm 0x1 0x7f00d0009fb0 2 -> 1 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=- has_dir_layout 0x7f00d000a0a0) 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _put_inode on 0x1000000000a.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) n = 10 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 remove_cap mds.0 on 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=pAsLsXsFsx(0=pAsLsXsFsx) COMPLETE 0x7f00d000ba90) 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 15 client.4740 remove_cap last one, closing snaprealm 0x7f00d0009fb0 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 20 client.4740 put_snap_realm 0x1 0x7f00d0009fb0 1 -> 0 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 10 client.4740 _put_inode deleting 0x1000000000a.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40777 size=0/0 nlink=0 btime=2024-03-23T23:58:21.301404+0000 mtime=2024-03-23T23:58:21.301404+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=1 caps=- COMPLETE 0x7f00d000ba90) 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 2 client.4740 _close_mds_session mds.0 seq 5 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 5) v7 -- 0x5611a127ad90 con 0x5611a139e080 2024-03-23T23:58:21.329 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.324+0000 7f010c985480 2 client.4740 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.330 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 <== mds.0 v2:172.21.15.59:6834/3774186650 12 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a13a4ce0 con 0x5611a139e080 2024-03-23T23:58:21.330 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 10 client.4740 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.330 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 5 client.4740 _closed_mds_session mds.0 seq 5 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 1 -- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a1247e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 10 client.4740 remove_session_caps mds.0 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 10 client.4740 kick_requests_closed for mds.0 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 10 client.4740 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 20 client.4740 trim_cache size 0 max 16384 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f0102000640 10 client.4740 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 2 client.4740 unmounted. 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 client.4740 shutdown 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 msgr2=0x5611a12f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a12f7520 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0104007040 tx=0x7f010406f000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 shutdown_connections 2024-03-23T23:58:21.331 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a1247e20 unknown :-1 s=CLOSED pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a12f7520 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 --2- 172.21.15.31:0/2562859875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1232360 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 >> 172.21.15.31:0/2562859875 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.330+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 shutdown_connections 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.331+0000 7f010c985480 1 -- 172.21.15.31:0/2562859875 wait complete. 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.331+0000 7f010c985480 20 client.4740 trim_cache size 0 max 16384 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.AlternateNameLong (46 ms) 2024-03-23T23:58:21.332 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameCreat 2024-03-23T23:58:21.333 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.332+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.333 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.333+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.334 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.334+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.334 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.334+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.334 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.334+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.335 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.334+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0004d60 con 0x5611a1232360 2024-03-23T23:58:21.335 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.334+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a127a450 con 0x5611a1278020 2024-03-23T23:58:21.335 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.334+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a12408a0 con 0x5611a139db40 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a1247e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33602/0 (socket says 172.21.15.31:33602) 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 -- 172.21.15.31:0/24960361 learned_addr learned my addr 172.21.15.31:0/24960361 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0103e00640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f010a600640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 -- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 msgr2=0x5611a13a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 -- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1278020 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.336 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0109c00640 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a91c0 con 0x5611a1232360 2024-03-23T23:58:21.337 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f010a600640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a13a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:21.337 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.335+0000 7f0103e00640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1278020 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:21.337 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f0109c00640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a1247e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00fc001580 tx=0x5611a13b5c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30ab9b21e2277e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.337 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f010c985480 10 client.4743 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.337 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f0103400640 10 client.4743 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.337 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a13b26f0 con 0x5611a1232360 2024-03-23T23:58:21.338 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc057040 con 0x5611a1232360 2024-03-23T23:58:21.338 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f00faa00640 20 client.4743 tick 2024-03-23T23:58:21.338 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f00faa00640 20 client.4743 collect_and_send_metrics 2024-03-23T23:58:21.338 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f00faa00640 20 client.4743 collect_and_send_global_metrics 2024-03-23T23:58:21.338 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f00faa00640 5 client.4743 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.338 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f00faa00640 20 client.4743 trim_cache size 0 max 16384 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f00fc066b70 con 0x5611a1232360 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f00faa00640 20 client.4743 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc045d00 con 0x5611a1232360 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f0103400640 1 client.4743 handle_mds_map epoch 8 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.336+0000 7f010c985480 20 client.4743 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.337+0000 7f010c985480 10 client.4743 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.337+0000 7f010c985480 20 client.4743 mds is 0 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.337+0000 7f010c985480 10 client.4743 _open_mds_session mds.0 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.337+0000 7f010c985480 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.337+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a1308ae0 con 0x5611a139e080 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.337+0000 7f010c985480 10 client.4743 waiting for session to mds.0 to open 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.337+0000 7f0103e00640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.338+0000 7f0103e00640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e632a32bf4266cfb server_cookie=4ba96bbd111c2fd7 in_seq=0 out_seq=0 2024-03-23T23:58:21.339 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.338+0000 7f0103400640 10 client.4743 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a1308ae0 con 0x5611a139e080 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f0103400640 10 client.4743 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f0103400640 10 client.4743 renew_caps mds.0 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d00047a0 con 0x5611a139e080 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f0103400640 10 client.4743 connect_mds_targets for mds.0 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f010c985480 10 client.4743 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f010c985480 20 client.4743 mds is 0 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f010c985480 10 client.4743 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f010c985480 20 client.4743 encode_cap_releases enter (req: 0x5611a12f56c0, mds: 0) 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f010c985480 20 client.4743 send_request set sent_stamp to 2024-03-23T23:58:21.343950+0000 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f010c985480 10 client.4743 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.338023+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.343 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.342+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.338023+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f7ff0 con 0x5611a139e080 2024-03-23T23:58:21.344 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.343+0000 7f010c985480 20 client.4743 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.344 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.343+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d00047a0 con 0x5611a139e080 2024-03-23T23:58:21.344 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.343+0000 7f0103400640 10 client.4743 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f4005a40 con 0x5611a139e080 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 insert_trace from 2024-03-23T23:58:21.343950+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 features 0xffffffffffffffff 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 update_snap_trace len 70 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0x7f00d000a0a0, nref now is 1 2024-03-23T23:58:21.345 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 15 client.4743 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 15 client.4743 snapc 1=[] 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 put_snap_realm 0x1 0x7f00d000a0a0 2 -> 1 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a190) - ctime 2024-03-23T23:58:21.310480+0000 mtime 2024-03-23T23:58:21.310480+0000 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 dir hash is 2 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 12 client.4743 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 21 2024-03-23T23:58:21.346 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 12 client.4743 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=- has_dir_layout 0x7f00d000a190) caps pAsLsXsFs 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0x7f00d000a0a0, nref was 1 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0x7f00d000a0a0, nref now is 2 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 15 client.4743 add_update_cap first one, opened snaprealm 0x7f00d000a0a0 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 10 client.4743 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 put_snap_realm 0x1 0x7f00d000a0a0 2 -> 1 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 lat 0.001460 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 _ll_get 0x7f00d000a190 0x1 -> 1 2024-03-23T23:58:21.347 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 3 client.4743 openat enter(AlternateNameCreat_44572) 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f0103400640 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 10 client.4743 path_walk AlternateNameCreat_44572 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 10 client.4743 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) AlternateNameCreat_44572 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 (path is AlternateNameCreat_44572) 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 10 client.4743 _getattr mask As issued=1 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 3 client.4743 may_lookup 0x7f00d000a190 = 0 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 10 client.4743 _do_lookup on #0x1/AlternateNameCreat_44572 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.348 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 choose_target_mds inode dir hash is 2 on AlternateNameCreat_44572 => 136222003 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) is_hash=1 hash=136222003 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 10 client.4743 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 mds is 0 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 10 client.4743 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 encode_cap_releases enter (req: 0x5611a1240ba0, mds: 0) 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 send_request set sent_stamp to 2024-03-23T23:58:21.345491+0000 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 10 client.4743 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameCreat_44572 2024-03-23T23:58:21.345475+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/AlternateNameCreat_44572 2024-03-23T23:58:21.345475+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276a00 con 0x5611a139e080 2024-03-23T23:58:21.349 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.344+0000 7f010c985480 20 client.4743 awaiting reply|forward|kick on 0x7ffef73341c0 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f4005310 con 0x5611a139e080 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f0103400640 20 client.4743 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f0103400640 10 client.4743 insert_trace from 2024-03-23T23:58:21.345491+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f0103400640 10 client.4743 insert_trace -- no trace 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f0103400640 20 client.4743 handle_client_reply signalling caller 0x7ffef73341c0 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f0103400640 20 client.4743 handle_client_reply awaiting kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 sendrecv kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 lat 0.000863 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 10 client.4743 _do_lookup res is -2 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 10 client.4743 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) AlternateNameCreat_44572 = -2 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.350 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 10 client.4743 path_walk 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 10 client.4743 _getattr mask As issued=1 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 3 client.4743 may_create 0x7f00d000a190 = 0 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 8 client.4743 _create(0x1 AlternateNameCreat_44572, 0777) 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) name AlternateNameCreat_44572 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 15 open_dir 0x5611a127afc0 on 0x7f00d000a190 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 15 client.4743 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 'AlternateNameCreat_44572' dn 0x1.head["AlternateNameCreat_44572"] (new dn) 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 choose_target_mds inode dir hash is 2 on AlternateNameCreat_44572 => 136222003 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) is_hash=1 hash=136222003 2024-03-23T23:58:21.351 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 10 client.4743 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 mds is 0 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 10 client.4743 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 encode_cap_releases enter (req: 0x5611a1276a00, mds: 0) 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 encode_dentry_release enter(dn:0x7f00d0009fb0) 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190), req:0x5611a1276a00 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 send_request set sent_stamp to 2024-03-23T23:58:21.346496+0000 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 10 client.4743 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameCreat_44572 (foo) 2024-03-23T23:58:21.346471+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameCreat_44572 (foo) 2024-03-23T23:58:21.346471+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12764b0 con 0x5611a139e080 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f010c985480 20 client.4743 awaiting reply|forward|kick on 0x7ffef7334520 2024-03-23T23:58:21.352 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.345+0000 7f0103400640 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.353 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 848+0+0 (crc 0 0 0) 0x7f00f4066740 con 0x5611a139e080 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 insert_trace from 2024-03-23T23:58:21.346496+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 features 0xffffffffffffffff 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 update_snap_trace len 70 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0x7f00d000a0a0, nref was 1 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0x7f00d000a0a0, nref now is 2 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 update_inode_file_time 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a770) - ctime 2024-03-23T23:58:21.346471+0000 mtime 2024-03-23T23:58:21.346471+0000 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 12 client.4743 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 12 client.4743 add_update_inode adding 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=- objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a770) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0x7f00d000a0a0, nref was 2 2024-03-23T23:58:21.354 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 get_snap_realm 0x1 0x7f00d000a0a0, nref now is 3 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 15 client.4743 add_update_cap first one, opened snaprealm 0x7f00d000a0a0 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a770) 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 12 client.4743 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a190) caps pAsLsXsFs 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.310480+0000 ctime=2024-03-23T23:58:21.310480+0000 change_attr=21 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a190) pAsLsXs ctime 2024-03-23T23:58:21.346471+0000 mtime 2024-03-23T23:58:21.346471+0000 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 dir hash is 2 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 12 client.4743 add_update_inode client inode change_attr: 21 , mds inodestat change_attr: 22 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 10 client.4743 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 12 client.4743 insert_dentry_inode 'AlternateNameCreat_44572' vino 0x1000000000b.head in dir 0x1.head dn 0x7f00d0009fb0 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 15 client.4743 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 'AlternateNameCreat_44572' to inode 0x7f00d000a770 dn 0x1.head["AlternateNameCreat_44572"] (old dn) 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.355 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 link inode 0x7f00d000a770 parents now 0x1.head["AlternateNameCreat_44572"] 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 15 client.4743 update_dentry_lease 0x1.head["AlternateNameCreat_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.346496+0000 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 put_snap_realm 0x1 0x7f00d000a0a0 3 -> 2 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 handle_client_reply signalling caller 0x7ffef7334520 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 handle_client_reply awaiting kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 sendrecv kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 client.4743 delegated_inos: [] 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 client.4743 make_request created ino 0x1000000000b 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 make_request target is 0x1000000000b.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 lat 0.007438 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 break_deleg: breaking delegs on 0x1000000000b.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 delegations_broken: delegations empty on 0x1000000000b.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.356 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 client.4743 _create_fh 0x1000000000b mode 2 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 trim_cache size 1 max 16384 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 8 client.4743 create(#0x1/AlternateNameCreat_44572, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 3 client.4743 openat exit(AlternateNameCreat_44572) 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 client.4743 get_quota_root realm 0x1 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 client.4743 get_quota_root 0x1000000000b.head -> 0x1.head 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 10 client.4743 cur file size is 0 2024-03-23T23:58:21.357 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x5611a1307ef0 0x5611a1308370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.358 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] -- osd_op(unknown.0.0:1 3.29 3:9752f43f:::1000000000b.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a12ede40 con 0x5611a1307ef0 2024-03-23T23:58:21.358 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] -- osd_op(unknown.0.0:2 3.29 3:9752f43f:::1000000000b.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a12ee6b0 con 0x5611a1307ef0 2024-03-23T23:58:21.358 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.358 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f0103400640 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.358 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.353+0000 7f010a600640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x5611a1307ef0 0x5611a1308370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.360 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.354+0000 7f010a600640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x5611a1307ef0 0x5611a1308370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=79ffd2d3acd732ab server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.360 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.354+0000 7f0103400640 10 client.4743 ms_handle_connect on v2:172.21.15.31:6823/2450082534 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.355+0000 7f010a600640 1 -- 172.21.15.31:0/24960361 <== osd.3 v2:172.21.15.31:6823/2450082534 1 ==== osd_op_reply(1 1000000000b.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a1307ef0 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010a600640 1 -- 172.21.15.31:0/24960361 <== osd.3 v2:172.21.15.31:6823/2450082534 2 ==== osd_op_reply(2 1000000000b.00000000 [create] v24'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a1307ef0 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 wanted_max_size 0 -> 3 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 get_caps 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 clear_suid_sgid 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 5 client.4743 get_cap_ref got first FILE_BUFFER ref on 0x1000000000b.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 5 client.4743 get_cap_ref got first FILE_CACHE ref on 0x1000000000b.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 mark_caps_dirty 0x1000000000b.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) - -> Fw 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 cap_delay_requeue on 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.361 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 get_quota_root realm 0x1 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 get_quota_root 0x1000000000b.head -> 0x1.head 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 7 client.4743 wrote to 3, extending file size 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 mark_caps_dirty 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) Fw -> Fw 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 cap_delay_requeue on 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 3 client.4743 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 3 client.4743 close enter(10) 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 8 client.4743 _release_fh 0x5611a12f8020 mode 2 on 0x1000000000b.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _flush 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] -- osd_op(unknown.0.0:3 3.29 3:9752f43f:::1000000000b.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a124c680 con 0x5611a1307ef0 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 check_caps on 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 delaying cap release 2024-03-23T23:58:21.362 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 cap_delay_requeue on 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _release_fh 0x5611a12f8020 on inode 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) no async_err state 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 3 client.4743 close exit(10) 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 walk: AlternateNameCreat_44572 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 path_walk AlternateNameCreat_44572 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 0 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) AlternateNameCreat_44572 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 (path is AlternateNameCreat_44572) 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 may_lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _getattr mask As issued=1 2024-03-23T23:58:21.363 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 3 client.4743 may_lookup 0x7f00d000a190 = 0 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 _lookup have 0x1.head["AlternateNameCreat_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) AlternateNameCreat_44572 = 0x1000000000b.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 2 client.4743 unmount 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 2 client.4743 unmounting 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _ll_drop_pins 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 _ll_put 0x7f00d000a190 0x1 1 -> 0 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.364 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 _release 0x1000000000b.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _flush 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 _release 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 _flush 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 nothing to flush 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 flush_caps_sync 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 check_caps on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=3 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 mark_caps_flushing Fw 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.365 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 mark_caps_clean 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.366 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 10 client.4743 send_cap 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) mds.0 seq 1 used Fcb want Fxcb flush Fw retain pFxcb held pAsxLsXsxFsxcrwb revoking - dropping AsxLsXsxFsrw 2024-03-23T23:58:21.366 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 15 client.4743 auth cap, requesting max_size 3 2024-03-23T23:58:21.366 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.358+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x1000000000b 1 seq 1 tid 2 caps=pFxcb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.359565+0000 ctime 2024-03-23T23:58:21.359565+0000 change_attr 1) v12 -- 0x5611a12eeac0 con 0x5611a139e080 2024-03-23T23:58:21.366 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.359+0000 7f010c985480 10 client.4743 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-03-23T23:58:21.366 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.359+0000 7f010c985480 10 client.4743 waiting on mds.0 tid 2 (want 2) 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.362+0000 7f010a600640 1 -- 172.21.15.31:0/24960361 <== osd.3 v2:172.21.15.31:6823/2450082534 3 ==== osd_op_reply(3 1000000000b.00000000 [write 0~3] v24'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a1307ef0 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.362+0000 7f0100c00640 10 client.4743 _flushed 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.362+0000 7f0100c00640 5 client.4743 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.362+0000 7f0100c00640 5 client.4743 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.362+0000 7f0100c00640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 2 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.362+0000 7f0100c00640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.362+0000 7f0100c00640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.367 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(flush_ack ino 0x1000000000b 1 seq 1 tid 2 caps=pFxcb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x5611a12eeac0 con 0x5611a139e080 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 5 client.4743 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 10 client.4743 mds.0 seq now 1 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 5 client.4743 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) flushing_caps=Fw objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) with Fw 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 5 client.4743 flushing_caps Fw -> - 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 10 client.4743 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) !flushing 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 10 client.4743 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameCreat_44572"] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 10 client.4743 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 20 client.4743 trim_cache size 1 max 16384 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 15 client.4743 trim_dentry unlinking dn AlternateNameCreat_44572 in dir 0x1 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 15 client.4743 unlink dir 0x7f00d000a190 'AlternateNameCreat_44572' dn 0x7f00d0009fb0 inode 0x7f00d000a770 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 20 client.4743 unlink inode 0x7f00d000a770 parents now 2024-03-23T23:58:21.368 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 15 client.4743 unlink removing 'AlternateNameCreat_44572' dn 0x7f00d0009fb0 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 15 client.4743 close_dir dir 0x5611a127afc0 on 0x7f00d000a190 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 20 client.4743 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 1 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 20 client.4743 put_inode on 0x1000000000b.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a770) n = 1 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f0103400640 10 client.4743 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 10 client.4743 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 20 client.4743 trim_cache size 0 max 16384 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 10 client.4743 _put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) n = 19 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 10 client.4743 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.369 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 15 client.4743 remove_cap last one, closing snaprealm 0x7f00d000a0a0 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 20 client.4743 put_snap_realm 0x1 0x7f00d000a0a0 2 -> 1 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 10 client.4743 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=- has_dir_layout 0x7f00d000a190) 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 10 client.4743 _put_inode on 0x1000000000b.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a770) n = 15 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 10 client.4743 remove_cap mds.0 on 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=pFxcb(0=pFxcb) objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a770) 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 15 client.4743 remove_cap last one, closing snaprealm 0x7f00d000a0a0 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 20 client.4743 put_snap_realm 0x1 0x7f00d000a0a0 1 -> 0 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 10 client.4743 _put_inode deleting 0x1000000000b.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.346471+0000 mtime=2024-03-23T23:58:21.359565+0000 ctime=2024-03-23T23:58:21.359565+0000 change_attr=1 caps=- objectset[0x1000000000b ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a770) 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 2 client.4743 _close_mds_session mds.0 seq 1 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 1) v7 -- 0x5611a12ee200 con 0x5611a139e080 2024-03-23T23:58:21.370 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.364+0000 7f010c985480 2 client.4743 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12ee200 con 0x5611a139e080 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 10 client.4743 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 5 client.4743 _closed_mds_session mds.0 seq 1 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 1 -- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 msgr2=0x5611a12f7520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139e080 0x5611a12f7520 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 10 client.4743 remove_session_caps mds.0 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 10 client.4743 kick_requests_closed for mds.0 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 10 client.4743 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.372 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 20 client.4743 trim_cache size 0 max 16384 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f0103400640 10 client.4743 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f010c985480 2 client.4743 unmounted. 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.369+0000 7f010c985480 1 client.4743 shutdown 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x5611a1307ef0 msgr2=0x5611a1308370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x5611a1307ef0 0x5611a1308370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 msgr2=0x5611a1247e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 --2- 172.21.15.31:0/24960361 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a1232360 0x5611a1247e20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00fc001580 tx=0x5611a13b5c10 comp rx=0 tx=0).stop 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010a600640 1 -- 172.21.15.31:0/24960361 reap_dead start 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 shutdown_connections 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 >> 172.21.15.31:0/24960361 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 shutdown_connections 2024-03-23T23:58:21.373 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.370+0000 7f010c985480 1 -- 172.21.15.31:0/24960361 wait complete. 2024-03-23T23:58:21.374 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.371+0000 7f010c985480 20 client.4743 trim_cache size 0 max 16384 2024-03-23T23:58:21.374 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.AlternateNameCreat (40 ms) 2024-03-23T23:58:21.374 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameSymlink 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.371+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.372+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.373+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127cad0 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.373+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1276330 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.373+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f5580 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.373+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0009030 con 0x5611a127cad0 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.373+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1312b70 con 0x5611a1276330 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.373+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13066b0 con 0x5611a12f5580 2024-03-23T23:58:21.377 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.373+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127cad0 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127cad0 0x5611a1247e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33606/0 (socket says 172.21.15.31:33606) 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0109c00640 1 -- 172.21.15.31:0/4103721558 learned_addr learned my addr 172.21.15.31:0/4103721558 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0103e00640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1276330 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f010a600640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f5580 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0109c00640 1 -- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f5580 msgr2=0x5611a13a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0109c00640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f5580 0x5611a13a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0109c00640 1 -- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1276330 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0109c00640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1276330 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.374+0000 7f0109c00640 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a8620 con 0x5611a127cad0 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f0109c00640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127cad0 0x5611a1247e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f00fc05d040 tx=0x5611a13a4ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87d25f6be9ddd5d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f0102000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.378 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc057070 con 0x5611a127cad0 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f00fc009b60 con 0x5611a127cad0 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f010c985480 10 client.4746 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a12f3cf0 con 0x5611a127cad0 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f00fb400640 20 client.4746 tick 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f00fb400640 20 client.4746 collect_and_send_metrics 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f00fb400640 20 client.4746 collect_and_send_global_metrics 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f00fb400640 5 client.4746 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f00fb400640 20 client.4746 trim_cache size 0 max 16384 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.375+0000 7f00fb400640 20 client.4746 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mon.0 v2:172.21.15.31:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611a12f4b50 con 0x5611a127cad0 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc023930 con 0x5611a127cad0 2024-03-23T23:58:21.379 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f0102000640 1 client.4746 handle_mds_map epoch 8 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f010c985480 20 client.4746 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f010c985480 10 client.4746 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f010c985480 20 client.4746 mds is 0 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f010c985480 10 client.4746 _open_mds_session mds.0 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f010c985480 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a3eb0 0x5611a12768e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a12f7520 con 0x5611a13a3eb0 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f010c985480 10 client.4746 waiting for session to mds.0 to open 2024-03-23T23:58:21.380 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.376+0000 7f0103e00640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a3eb0 0x5611a12768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.381 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.377+0000 7f0103e00640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a3eb0 0x5611a12768e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed27e832f95efd24 server_cookie=d5b54c140c59a57b in_seq=0 out_seq=0 2024-03-23T23:58:21.381 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.377+0000 7f0102000640 10 client.4746 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a12f7520 con 0x5611a13a3eb0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f0102000640 10 client.4746 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f0102000640 10 client.4746 renew_caps mds.0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0003240 con 0x5611a13a3eb0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f0102000640 10 client.4746 connect_mds_targets for mds.0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 10 client.4746 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 20 client.4746 mds is 0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 10 client.4746 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 20 client.4746 encode_cap_releases enter (req: 0x5611a12f4330, mds: 0) 2024-03-23T23:58:21.383 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 20 client.4746 send_request set sent_stamp to 2024-03-23T23:58:21.383926+0000 2024-03-23T23:58:21.384 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 10 client.4746 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.377301+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.384 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.377301+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a0e50 con 0x5611a13a3eb0 2024-03-23T23:58:21.384 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.382+0000 7f010c985480 20 client.4746 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.384 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.383+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0003240 con 0x5611a13a3eb0 2024-03-23T23:58:21.384 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.383+0000 7f0102000640 10 client.4746 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f4005310 con 0x5611a13a3eb0 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 insert_trace from 2024-03-23T23:58:21.383926+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 features 0xffffffffffffffff 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 update_snap_trace len 70 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref now is 1 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 15 client.4746 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 15 client.4746 snapc 1=[] 2024-03-23T23:58:21.386 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 2 -> 1 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a280) - ctime 2024-03-23T23:58:21.346471+0000 mtime 2024-03-23T23:58:21.346471+0000 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 dir hash is 2 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 12 client.4746 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 22 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 12 client.4746 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=- has_dir_layout 0x7f00d000a280) caps pAsLsXsFs 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref was 1 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref now is 2 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 15 client.4746 add_update_cap first one, opened snaprealm 0x7f00d000a190 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 10 client.4746 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.387 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 2 -> 1 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 lat 0.001539 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 _ll_get 0x7f00d000a280 0x1 -> 1 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 3 client.4746 openat enter(AlternateNameSymlink_44572) 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f0102000640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 10 client.4746 path_walk AlternateNameSymlink_44572 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 10 client.4746 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) AlternateNameSymlink_44572 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 (path is AlternateNameSymlink_44572) 2024-03-23T23:58:21.388 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 10 client.4746 _getattr mask As issued=1 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 3 client.4746 may_lookup 0x7f00d000a280 = 0 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 10 client.4746 _do_lookup on #0x1/AlternateNameSymlink_44572 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 choose_target_mds inode dir hash is 2 on AlternateNameSymlink_44572 => 4143568363 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=4143568363 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 10 client.4746 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 mds is 0 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 10 client.4746 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 encode_cap_releases enter (req: 0x5611a13a0e50, mds: 0) 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 send_request set sent_stamp to 2024-03-23T23:58:21.385569+0000 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 10 client.4746 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameSymlink_44572 2024-03-23T23:58:21.385539+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.389 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/AlternateNameSymlink_44572 2024-03-23T23:58:21.385539+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a12a0 con 0x5611a13a3eb0 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.384+0000 7f010c985480 20 client.4746 awaiting reply|forward|kick on 0x7ffef73341c0 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f4066950 con 0x5611a13a3eb0 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f0102000640 20 client.4746 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f0102000640 10 client.4746 insert_trace from 2024-03-23T23:58:21.385569+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f0102000640 10 client.4746 insert_trace -- no trace 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f0102000640 20 client.4746 handle_client_reply signalling caller 0x7ffef73341c0 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f0102000640 20 client.4746 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 lat 0.000851 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 10 client.4746 _do_lookup res is -2 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 10 client.4746 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) AlternateNameSymlink_44572 = -2 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.390 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 10 client.4746 path_walk 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 10 client.4746 _getattr mask As issued=1 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 3 client.4746 may_create 0x7f00d000a280 = 0 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 8 client.4746 _create(0x1 AlternateNameSymlink_44572, 0777) 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) name AlternateNameSymlink_44572 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 15 open_dir 0x5611a13a0950 on 0x7f00d000a280 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 15 client.4746 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 'AlternateNameSymlink_44572' dn 0x1.head["AlternateNameSymlink_44572"] (new dn) 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.391 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 choose_target_mds inode dir hash is 2 on AlternateNameSymlink_44572 => 4143568363 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=4143568363 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 10 client.4746 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 mds is 0 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 10 client.4746 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 encode_cap_releases enter (req: 0x5611a13a12a0, mds: 0) 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 encode_dentry_release enter(dn:0x7f00f00063c0) 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280), req:0x5611a13a12a0 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 send_request set sent_stamp to 2024-03-23T23:58:21.386561+0000 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 10 client.4746 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_44572 (foo) 2024-03-23T23:58:21.386520+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_44572 (foo) 2024-03-23T23:58:21.386520+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a139db40 con 0x5611a13a3eb0 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f010c985480 20 client.4746 awaiting reply|forward|kick on 0x7ffef7334520 2024-03-23T23:58:21.392 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.385+0000 7f0102000640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.394 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 850+0+0 (crc 0 0 0) 0x7f00f4052ba0 con 0x5611a13a3eb0 2024-03-23T23:58:21.394 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.394 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 insert_trace from 2024-03-23T23:58:21.386561+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.394 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 features 0xffffffffffffffff 2024-03-23T23:58:21.394 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 update_snap_trace len 70 2024-03-23T23:58:21.394 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref was 1 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref now is 2 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 update_inode_file_time 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) - ctime 2024-03-23T23:58:21.386520+0000 mtime 2024-03-23T23:58:21.386520+0000 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 12 client.4746 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 12 client.4746 add_update_inode adding 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=- objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref was 2 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref now is 3 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 15 client.4746 add_update_cap first one, opened snaprealm 0x7f00d000a190 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 12 client.4746 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) caps pAsLsXsFs 2024-03-23T23:58:21.395 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.346471+0000 ctime=2024-03-23T23:58:21.346471+0000 change_attr=22 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) pAsLsXs ctime 2024-03-23T23:58:21.386520+0000 mtime 2024-03-23T23:58:21.386520+0000 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 dir hash is 2 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 12 client.4746 add_update_inode client inode change_attr: 22 , mds inodestat change_attr: 23 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 10 client.4746 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 12 client.4746 insert_dentry_inode 'AlternateNameSymlink_44572' vino 0x1000000000c.head in dir 0x1.head dn 0x7f00f00063c0 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 15 client.4746 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 'AlternateNameSymlink_44572' to inode 0x7f00d000a860 dn 0x1.head["AlternateNameSymlink_44572"] (old dn) 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 link inode 0x7f00d000a860 parents now 0x1.head["AlternateNameSymlink_44572"] 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 15 client.4746 update_dentry_lease 0x1.head["AlternateNameSymlink_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.386561+0000 2024-03-23T23:58:21.396 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 3 -> 2 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 handle_client_reply signalling caller 0x7ffef7334520 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 client.4746 delegated_inos: [] 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 client.4746 make_request created ino 0x1000000000c 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 make_request target is 0x1000000000c.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 lat 0.007914 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 break_deleg: breaking delegs on 0x1000000000c.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 delegations_broken: delegations empty on 0x1000000000c.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 client.4746 _create_fh 0x1000000000c mode 2 2024-03-23T23:58:21.397 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 trim_cache size 1 max 16384 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 8 client.4746 create(#0x1/AlternateNameSymlink_44572, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 3 client.4746 openat exit(AlternateNameSymlink_44572) 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 client.4746 get_quota_root realm 0x1 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 client.4746 get_quota_root 0x1000000000c.head -> 0x1.head 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 10 client.4746 cur file size is 0 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a1270e30 0x5611a12732c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- osd_op(unknown.0.0:1 3.22 3:46cca9ab:::1000000000c.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1273800 con 0x5611a1270e30 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- osd_op(unknown.0.0:2 3.22 3:46cca9ab:::1000000000c.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1274070 con 0x5611a1270e30 2024-03-23T23:58:21.398 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.399 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.393+0000 7f0102000640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.399 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.394+0000 7f010a600640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a1270e30 0x5611a12732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.400 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.395+0000 7f0102000640 10 client.4746 ms_handle_connect on v2:172.21.15.59:6800/814178259 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.395+0000 7f010a600640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a1270e30 0x5611a12732c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=eb24df2fd6e1d736 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.396+0000 7f010a600640 1 -- 172.21.15.31:0/4103721558 <== osd.5 v2:172.21.15.59:6800/814178259 1 ==== osd_op_reply(1 1000000000c.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a1270e30 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010a600640 1 -- 172.21.15.31:0/4103721558 <== osd.5 v2:172.21.15.59:6800/814178259 2 ==== osd_op_reply(2 1000000000c.00000000 [create] v24'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a1270e30 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 wanted_max_size 0 -> 3 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 get_caps 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 clear_suid_sgid 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 5 client.4746 get_cap_ref got first FILE_BUFFER ref on 0x1000000000c.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 5 client.4746 get_cap_ref got first FILE_CACHE ref on 0x1000000000c.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 mark_caps_dirty 0x1000000000c.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) - -> Fw 2024-03-23T23:58:21.401 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 cap_delay_requeue on 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 get_quota_root realm 0x1 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 get_quota_root 0x1000000000c.head -> 0x1.head 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 7 client.4746 wrote to 3, extending file size 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 mark_caps_dirty 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) Fw -> Fw 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 cap_delay_requeue on 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 3 client.4746 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 3 client.4746 close enter(10) 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 8 client.4746 _release_fh 0x5611a13066b0 mode 2 on 0x1000000000c.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 _flush 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- osd_op(unknown.0.0:3 3.22 3:46cca9ab:::1000000000c.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1273800 con 0x5611a1270e30 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 check_caps on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.402 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 delaying cap release 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 cap_delay_requeue on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 _release_fh 0x5611a13066b0 on inode 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) no async_err state 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 3 client.4746 close exit(10) 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 path_walk 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 may_create 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 _getattr mask As issued=1 2024-03-23T23:58:21.403 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 3 client.4746 may_create 0x7f00d000a280 = 0 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 8 client.4746 _symlink(0x1 AlternateNameSymlink_445722, AlternateNameSymlink_44572, uid 0, gid 0) 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 get_or_create 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) name AlternateNameSymlink_445722 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 15 client.4746 link dir 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 'AlternateNameSymlink_445722' dn 0x1.head["AlternateNameSymlink_445722"] (new dn) 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 choose_target_mds inode dir hash is 2 on AlternateNameSymlink_445722 => 1754567765 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 choose_target_mds 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=1754567765 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 mds is 0 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 encode_cap_releases enter (req: 0x5611a139db40, mds: 0) 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 encode_dentry_release enter(dn:0x5611a11f75b0) 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280), req:0x5611a139db40 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.404 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 send_request set sent_stamp to 2024-03-23T23:58:21.400777+0000 2024-03-23T23:58:21.405 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 10 client.4746 send_request client_request(unknown.0:4 symlink owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_445722 (foo2) AlternateNameSymlink_44572 2024-03-23T23:58:21.400730+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.405 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 symlink owner_uid=0, owner_gid=0 #0x1/AlternateNameSymlink_445722 (foo2) AlternateNameSymlink_44572 2024-03-23T23:58:21.400730+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1273800 con 0x5611a13a3eb0 2024-03-23T23:58:21.405 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.399+0000 7f010c985480 20 client.4746 awaiting reply|forward|kick on 0x7ffef7334710 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_reply(???:4 = 0 (0) Success unsafe) v1 ==== 860+0+0 (crc 0 0 0) 0x7f00f408d840 con 0x5611a13a3eb0 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 handle_client_reply got a reply. Safe:0 tid 4 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 insert_trace from 2024-03-23T23:58:21.400777+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 features 0xffffffffffffffff 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 update_snap_trace len 70 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref was 2 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref now is 3 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.407 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 update_inode_file_time 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=120777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000ae40) - ctime 2024-03-23T23:58:21.400730+0000 mtime 2024-03-23T23:58:21.400730+0000 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 size 0 -> 26 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 12 client.4746 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 12 client.4746 add_update_inode adding 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=- 0x7f00d000ae40) caps pAsLsXsFscr 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref was 3 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref now is 4 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 15 client.4746 add_update_cap first one, opened snaprealm 0x7f00d000a190 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 add_update_cap issued - -> pAsLsXsFscr from mds.0 on 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 12 client.4746 add_update_inode had 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) caps pAsLsXs 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 update_inode_file_time 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.386520+0000 ctime=2024-03-23T23:58:21.386520+0000 change_attr=23 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) pAsLsXs ctime 2024-03-23T23:58:21.400730+0000 mtime 2024-03-23T23:58:21.400730+0000 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 dir hash is 2 2024-03-23T23:58:21.408 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 12 client.4746 add_update_inode client inode change_attr: 23 , mds inodestat change_attr: 24 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 10 client.4746 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 12 client.4746 insert_dentry_inode 'AlternateNameSymlink_445722' vino 0x1000000000d.head in dir 0x1.head dn 0x5611a11f75b0 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 15 client.4746 link dir 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 'AlternateNameSymlink_445722' to inode 0x7f00d000ae40 dn 0x1.head["AlternateNameSymlink_445722"] (old dn) 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 link inode 0x7f00d000ae40 parents now 0x1.head["AlternateNameSymlink_445722"] 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 15 client.4746 update_dentry_lease 0x1.head["AlternateNameSymlink_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.400777+0000 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 4 -> 3 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 handle_client_reply signalling caller 0x7ffef7334710 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f0102000640 20 client.4746 handle_client_reply awaiting kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:21.409 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 sendrecv kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 lat 0.002835 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 trim_cache size 2 max 16384 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 8 client.4746 _symlink("#0x1/AlternateNameSymlink_445722", "AlternateNameSymlink_44572") = 0 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 walk: AlternateNameSymlink_445722 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 path_walk cur=0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 path_walk AlternateNameSymlink_445722 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 0 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) AlternateNameSymlink_445722 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 (path is AlternateNameSymlink_445722) 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 may_lookup 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.410 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 _getattr mask As issued=1 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 3 client.4746 may_lookup 0x7f00d000a280 = 0 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 _lookup have 0x1.head["AlternateNameSymlink_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 _do_lookup on #0x1/AlternateNameSymlink_445722 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 choose_target_mds inode dir hash is 2 on AlternateNameSymlink_445722 => 1754567765 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 choose_target_mds 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=1754567765 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 mds is 0 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 send_request rebuilding request 5 for mds.0 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 encode_cap_releases enter (req: 0x5611a1273800, mds: 0) 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 send_request set sent_stamp to 2024-03-23T23:58:21.403755+0000 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 10 client.4746 send_request client_request(unknown.0:5 lookup #0x1/AlternateNameSymlink_445722 2024-03-23T23:58:21.403709+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.411 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:5 lookup #0x1/AlternateNameSymlink_445722 2024-03-23T23:58:21.403709+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1273bf0 con 0x5611a13a3eb0 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010c985480 20 client.4746 awaiting reply|forward|kick on 0x7ffef7334480 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.402+0000 7f010a600640 1 -- 172.21.15.31:0/4103721558 <== osd.5 v2:172.21.15.59:6800/814178259 3 ==== osd_op_reply(3 1000000000c.00000000 [write 0~3] v24'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a1270e30 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0100c00640 10 client.4746 _flushed 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0100c00640 5 client.4746 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0100c00640 5 client.4746 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0100c00640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 2 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0100c00640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameSymlink_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:5 = 0 (0) Success) v1 ==== 856+0+0 (crc 0 0 0) 0x7f00f406f7f0 con 0x5611a13a3eb0 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 handle_client_reply got a reply. Safe:1 tid 5 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 insert_trace from 2024-03-23T23:58:21.403755+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 features 0xffffffffffffffff 2024-03-23T23:58:21.412 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 update_snap_trace len 70 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref was 3 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 get_snap_realm 0x1 0x7f00d000a190, nref now is 4 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 12 client.4746 add_update_inode had 0x1000000000d.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) caps pAsLsXsFscr 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 12 client.4746 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 add_update_cap issued pAsLsXsFscr -> pAsLsXsFscr from mds.0 on 0x1000000000d.head(faked_ino=0 nref=5 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 12 client.4746 add_update_inode had 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) caps pAsLsXs 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 update_inode_file_time 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) pAsLsXs ctime 2024-03-23T23:58:21.400730+0000 mtime 2024-03-23T23:58:21.400730+0000 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 dir hash is 2 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 12 client.4746 add_update_inode client inode change_attr: 24 , mds inodestat change_attr: 24 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 10 client.4746 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.413 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 12 client.4746 insert_dentry_inode 'AlternateNameSymlink_445722' vino 0x1000000000d.head in dir 0x1.head dn 0x5611a11f75b0 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 12 client.4746 had dentry AlternateNameSymlink_445722 with correct vino 0x1000000000d.head 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el9/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/test/client/alternate_name.cc:101: Failure 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stdout:Expected equality of these values: 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stdout: wdr.alternate_name 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stdout: Which is: "" 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stdout: altname2 2024-03-23T23:58:21.414 INFO:tasks.workunit.client.0.smithi031.stdout: Which is: "foo2" 2024-03-23T23:58:21.416 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 15 client.4746 update_dentry_lease 0x1.head["AlternateNameSymlink_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.403755+0000 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 4 -> 3 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 handle_client_reply signalling caller 0x7ffef7334480 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f0102000640 20 client.4746 handle_client_reply awaiting kickback on tid 5 0x7f0101ffde80 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f010c985480 20 client.4746 sendrecv kickback on tid 5 0x7f0101ffde80 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.403+0000 7f010c985480 20 client.4746 make_request target is 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 20 client.4746 lat 0.001279 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 10 client.4746 _do_lookup res is 0 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 20 client.4746 _lookup have 0x1.head["AlternateNameSymlink_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 10 client.4746 _lookup 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) AlternateNameSymlink_445722 = 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 20 client.4746 symlink count 1, value is 'AlternateNameSymlink_44572' 2024-03-23T23:58:21.417 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f0102000640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 2 client.4746 unmount 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 2 client.4746 unmounting 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a139df60 con 0x5611a13a3eb0 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.404+0000 7f010c985480 10 client.4746 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_reply(???:4 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f406fa20 con 0x5611a13a3eb0 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 10 client.4746 insert_trace from 2024-03-23T23:58:21.400777+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.418 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 10 client.4746 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) parents=0x1.head["AlternateNameSymlink_445722"] 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 10 client.4746 unmounting: trim pass, size was 2+3 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 trim_cache size 2 max 16384 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 15 client.4746 trim_dentry unlinking dn AlternateNameSymlink_44572 in dir 0x1 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 15 client.4746 unlink dir 0x7f00d000a280 'AlternateNameSymlink_44572' dn 0x7f00f00063c0 inode 0x7f00d000a860 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 unlink inode 0x7f00d000a860 parents now 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 15 client.4746 unlink removing 'AlternateNameSymlink_44572' dn 0x7f00f00063c0 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 15 client.4746 trim_dentry unlinking dn AlternateNameSymlink_445722 in dir 0x1 2024-03-23T23:58:21.419 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 15 client.4746 unlink dir 0x7f00d000a280 'AlternateNameSymlink_445722' dn 0x5611a11f75b0 inode 0x7f00d000ae40 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 unlink inode 0x7f00d000ae40 parents now 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 15 client.4746 unlink removing 'AlternateNameSymlink_445722' dn 0x5611a11f75b0 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 15 client.4746 close_dir dir 0x5611a13a0950 on 0x7f00d000a280 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f0102000640 10 client.4746 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 _ll_drop_pins 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 _ll_put 0x7f00d000a280 0x1 1 -> 0 2024-03-23T23:58:21.420 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 _release 0x1000000000d.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 _invalidate_inode_cache 0x1000000000d.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 _flush 0x1000000000d.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 nothing to flush 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 _release 0x1000000000c.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 _invalidate_inode_cache 0x1000000000c.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 _flush 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 nothing to flush 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.421 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 _release 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 _flush 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 10 client.4746 nothing to flush 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.409+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000d.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) n = 1 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 20 client.4746 put_inode on 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 client.4746 flush_caps_sync 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 client.4746 check_caps on 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) wanted - used - issued pAsxLsXsxFsxcrwb revoking - flags=3 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 client.4746 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 client.4746 mark_caps_flushing Fw 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.422 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 mark_caps_clean 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 client.4746 send_cap 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) mds.0 seq 1 used - want - flush Fw retain p held pAsxLsXsxFsxcrwb revoking - dropping AsxLsXsxFsxcrwb 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 15 client.4746 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x1000000000c 1 seq 1 tid 2 caps=p dirty=Fw wanted=- follows 1 size 3/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.400453+0000 ctime 2024-03-23T23:58:21.400453+0000 change_attr 1) v12 -- 0x5611a124a660 con 0x5611a13a3eb0 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 client.4746 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.410+0000 7f010c985480 10 client.4746 waiting on mds.0 tid 2 (want 2) 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_caps(flush_ack ino 0x1000000000c 1 seq 1 tid 2 caps=p dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x5611a124a660 con 0x5611a13a3eb0 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 5 client.4746 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 10 client.4746 mds.0 seq now 1 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 5 client.4746 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=p(0=p) flushing_caps=Fw objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) with Fw 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 5 client.4746 flushing_caps Fw -> - 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 10 client.4746 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) !flushing 2024-03-23T23:58:21.423 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 10 client.4746 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 20 client.4746 put_inode on 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 10 client.4746 unmounting: trim pass, size was 0+3 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 20 client.4746 trim_cache size 0 max 16384 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f0102000640 10 client.4746 unmounting: trim pass, size still 0+3 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 20 client.4746 trim_cache size 0 max 16384 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 _put_inode on 0x1.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 25 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 15 client.4746 remove_cap last one, closing snaprealm 0x7f00d000a190 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 3 -> 2 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=- has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 _put_inode on 0x1000000000c.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 14 2024-03-23T23:58:21.424 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 remove_cap mds.0 on 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=p(0=p) objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 15 client.4746 remove_cap last one, closing snaprealm 0x7f00d000a190 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 2 -> 1 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 _put_inode deleting 0x1000000000c.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.386520+0000 mtime=2024-03-23T23:58:21.400453+0000 ctime=2024-03-23T23:58:21.400453+0000 change_attr=1 caps=- objectset[0x1000000000c ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 _put_inode on 0x1000000000d.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) n = 10 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 remove_cap mds.0 on 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=pAsLsXsFscr(0=pAsLsXsFscr) 0x7f00d000ae40) 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 15 client.4746 remove_cap last one, closing snaprealm 0x7f00d000a190 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 20 client.4746 put_snap_realm 0x1 0x7f00d000a190 1 -> 0 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 10 client.4746 _put_inode deleting 0x1000000000d.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=120777 size=26/0 nlink=1 btime=2024-03-23T23:58:21.400730+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=0 caps=- 0x7f00d000ae40) 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 2 client.4746 _close_mds_session mds.0 seq 1 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 1) v7 -- 0x5611a124ab70 con 0x5611a13a3eb0 2024-03-23T23:58:21.425 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.415+0000 7f010c985480 2 client.4746 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.427 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a124ab70 con 0x5611a13a3eb0 2024-03-23T23:58:21.427 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 10 client.4746 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.427 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 5 client.4746 _closed_mds_session mds.0 seq 1 2024-03-23T23:58:21.427 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 1 -- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a3eb0 msgr2=0x5611a12768e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.427 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a3eb0 0x5611a12768e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.427 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 10 client.4746 remove_session_caps mds.0 2024-03-23T23:58:21.427 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 10 client.4746 kick_requests_closed for mds.0 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 10 client.4746 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 20 client.4746 trim_cache size 0 max 16384 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f0102000640 10 client.4746 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f010c985480 2 client.4746 unmounted. 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.420+0000 7f010c985480 1 client.4746 shutdown 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a1270e30 msgr2=0x5611a12732c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010c985480 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x5611a1270e30 0x5611a12732c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127cad0 msgr2=0x5611a1247e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010c985480 1 --2- 172.21.15.31:0/4103721558 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127cad0 0x5611a1247e20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f00fc05d040 tx=0x5611a13a4ae0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010a600640 1 -- 172.21.15.31:0/4103721558 reap_dead start 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 shutdown_connections 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 >> 172.21.15.31:0/4103721558 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.421+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 shutdown_connections 2024-03-23T23:58:21.428 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.422+0000 7f010c985480 1 -- 172.21.15.31:0/4103721558 wait complete. 2024-03-23T23:58:21.429 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.422+0000 7f010c985480 20 client.4746 trim_cache size 0 max 16384 2024-03-23T23:58:21.429 INFO:tasks.workunit.client.0.smithi031.stdout:[ FAILED ] TestClient.AlternateNameSymlink (51 ms) 2024-03-23T23:58:21.429 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameRename 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.423+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.425+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.425+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127eb70 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a1240 0x5611a1276330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f4330 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0005690 con 0x5611a127eb70 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1274160 con 0x5611a13a1240 2024-03-23T23:58:21.432 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a124cff0 con 0x5611a12f4330 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127eb70 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f0109c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127eb70 0x5611a1247e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33612/0 (socket says 172.21.15.31:33612) 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f0109c00640 1 -- 172.21.15.31:0/2166537095 learned_addr learned my addr 172.21.15.31:0/2166537095 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.426+0000 7f0103e00640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a1240 0x5611a1276330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f010a600640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f4330 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0109c00640 1 -- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f4330 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0109c00640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a12f4330 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0109c00640 1 -- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a1240 msgr2=0x5611a1276330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0109c00640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13a1240 0x5611a1276330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0109c00640 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13b26f0 con 0x5611a127eb70 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0109c00640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127eb70 0x5611a1247e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5611a12fa900 tx=0x7f00fc03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c1a39a02b16d68 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f010c985480 10 client.4749 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.433 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a1234de0 con 0x5611a127eb70 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc057040 con 0x5611a127eb70 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.427+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f00fc039b50 con 0x5611a127eb70 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f00faa00640 20 client.4749 tick 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f00faa00640 20 client.4749 collect_and_send_metrics 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f00faa00640 20 client.4749 collect_and_send_global_metrics 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f00faa00640 5 client.4749 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f00faa00640 20 client.4749 trim_cache size 0 max 16384 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f00faa00640 20 client.4749 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc023930 con 0x5611a127eb70 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f0103400640 1 client.4749 handle_mds_map epoch 8 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f010c985480 20 client.4749 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f010c985480 10 client.4749 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.434 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f010c985480 20 client.4749 mds is 0 2024-03-23T23:58:21.435 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f010c985480 10 client.4749 _open_mds_session mds.0 2024-03-23T23:58:21.435 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f010c985480 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a127cad0 0x5611a13a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.435 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127ab70 con 0x5611a127cad0 2024-03-23T23:58:21.435 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.428+0000 7f010c985480 10 client.4749 waiting for session to mds.0 to open 2024-03-23T23:58:21.435 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.429+0000 7f0103e00640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a127cad0 0x5611a13a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.435 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.430+0000 7f0103e00640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a127cad0 0x5611a13a3eb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a6f8b5a788f5d7e server_cookie=1d27f00cdd626a51 in_seq=0 out_seq=0 2024-03-23T23:58:21.435 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.430+0000 7f0103400640 10 client.4749 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127ab70 con 0x5611a127cad0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f0103400640 10 client.4749 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f0103400640 10 client.4749 renew_caps mds.0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0007c10 con 0x5611a127cad0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f0103400640 10 client.4749 connect_mds_targets for mds.0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 10 client.4749 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 20 client.4749 mds is 0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 10 client.4749 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.440 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 20 client.4749 encode_cap_releases enter (req: 0x5611a12f7ed0, mds: 0) 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 20 client.4749 send_request set sent_stamp to 2024-03-23T23:58:21.436239+0000 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 10 client.4749 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.429583+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.429583+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13019d0 con 0x5611a127cad0 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f010c985480 20 client.4749 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0007c10 con 0x5611a127cad0 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.435+0000 7f0103400640 10 client.4749 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f4066950 con 0x5611a127cad0 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 insert_trace from 2024-03-23T23:58:21.436239+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 features 0xffffffffffffffff 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 update_snap_trace len 70 2024-03-23T23:58:21.441 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref now is 1 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 15 client.4749 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 15 client.4749 snapc 1=[] 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 put_snap_realm 0x1 0x7f00d0007e30 2 -> 1 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d000a280) - ctime 2024-03-23T23:58:21.400730+0000 mtime 2024-03-23T23:58:21.400730+0000 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 dir hash is 2 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 12 client.4749 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 24 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 12 client.4749 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=- has_dir_layout 0x7f00d000a280) caps pAsLsXsFs 2024-03-23T23:58:21.442 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref was 1 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref now is 2 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 15 client.4749 add_update_cap first one, opened snaprealm 0x7f00d0007e30 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 10 client.4749 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 put_snap_realm 0x1 0x7f00d0007e30 2 -> 1 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 lat 0.001247 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 _ll_get 0x7f00d000a280 0x1 -> 1 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 3 client.4749 openat enter(AlternateNameRename_44572) 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 10 client.4749 path_walk AlternateNameRename_44572 2024-03-23T23:58:21.443 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 10 client.4749 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) AlternateNameRename_44572 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 (path is AlternateNameRename_44572) 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 10 client.4749 _getattr mask As issued=1 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 3 client.4749 may_lookup 0x7f00d000a280 = 0 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 10 client.4749 _do_lookup on #0x1/AlternateNameRename_44572 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 choose_target_mds inode dir hash is 2 on AlternateNameRename_44572 => 2242999335 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=2242999335 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 10 client.4749 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 mds is 0 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 10 client.4749 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.444 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 encode_cap_releases enter (req: 0x5611a13a1a40, mds: 0) 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 send_request set sent_stamp to 2024-03-23T23:58:21.437685+0000 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 10 client.4749 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRename_44572 2024-03-23T23:58:21.437613+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRename_44572 2024-03-23T23:58:21.437613+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a139db40 con 0x5611a127cad0 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f010c985480 20 client.4749 awaiting reply|forward|kick on 0x7ffef73341c0 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.436+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f40527e0 con 0x5611a127cad0 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f0103400640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f0103400640 10 client.4749 insert_trace from 2024-03-23T23:58:21.437685+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f0103400640 10 client.4749 insert_trace -- no trace 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f0103400640 20 client.4749 handle_client_reply signalling caller 0x7ffef73341c0 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f0103400640 20 client.4749 handle_client_reply awaiting kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.445 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 sendrecv kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 lat 0.000766 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 10 client.4749 _do_lookup res is -2 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 10 client.4749 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) AlternateNameRename_44572 = -2 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 10 client.4749 path_walk 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.446 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 10 client.4749 _getattr mask As issued=1 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 3 client.4749 may_create 0x7f00d000a280 = 0 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 8 client.4749 _create(0x1 AlternateNameRename_44572, 0777) 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) name AlternateNameRename_44572 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 15 open_dir 0x5611a124cb00 on 0x7f00d000a280 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 15 client.4749 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 'AlternateNameRename_44572' dn 0x1.head["AlternateNameRename_44572"] (new dn) 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 choose_target_mds inode dir hash is 2 on AlternateNameRename_44572 => 2242999335 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=2242999335 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 10 client.4749 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 mds is 0 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 10 client.4749 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.447 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 encode_cap_releases enter (req: 0x5611a139db40, mds: 0) 2024-03-23T23:58:21.448 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 encode_dentry_release enter(dn:0x7f00d000a0a0) 2024-03-23T23:58:21.448 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280), req:0x5611a139db40 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.448 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 send_request set sent_stamp to 2024-03-23T23:58:21.438773+0000 2024-03-23T23:58:21.448 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 10 client.4749 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRename_44572 (foo) 2024-03-23T23:58:21.438681+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.448 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRename_44572 (foo) 2024-03-23T23:58:21.438681+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1275330 con 0x5611a127cad0 2024-03-23T23:58:21.448 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f010c985480 20 client.4749 awaiting reply|forward|kick on 0x7ffef7334520 2024-03-23T23:58:21.448 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.437+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.454 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 849+0+0 (crc 0 0 0) 0x7f00f406f430 con 0x5611a127cad0 2024-03-23T23:58:21.454 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.454 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 insert_trace from 2024-03-23T23:58:21.438773+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.454 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 features 0xffffffffffffffff 2024-03-23T23:58:21.454 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 update_snap_trace len 70 2024-03-23T23:58:21.454 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref was 1 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref now is 2 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) - ctime 2024-03-23T23:58:21.438681+0000 mtime 2024-03-23T23:58:21.438681+0000 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 12 client.4749 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 12 client.4749 add_update_inode adding 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=- objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref was 2 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref now is 3 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 15 client.4749 add_update_cap first one, opened snaprealm 0x7f00d0007e30 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 12 client.4749 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) caps pAsLsXsFs 2024-03-23T23:58:21.455 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.400730+0000 ctime=2024-03-23T23:58:21.400730+0000 change_attr=24 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) pAsLsXs ctime 2024-03-23T23:58:21.438681+0000 mtime 2024-03-23T23:58:21.438681+0000 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 dir hash is 2 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 12 client.4749 add_update_inode client inode change_attr: 24 , mds inodestat change_attr: 25 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 10 client.4749 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 12 client.4749 insert_dentry_inode 'AlternateNameRename_44572' vino 0x1000000000e.head in dir 0x1.head dn 0x7f00d000a0a0 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 15 client.4749 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 'AlternateNameRename_44572' to inode 0x7f00d000a860 dn 0x1.head["AlternateNameRename_44572"] (old dn) 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 link inode 0x7f00d000a860 parents now 0x1.head["AlternateNameRename_44572"] 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 15 client.4749 update_dentry_lease 0x1.head["AlternateNameRename_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.438773+0000 2024-03-23T23:58:21.456 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 put_snap_realm 0x1 0x7f00d0007e30 3 -> 2 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 handle_client_reply signalling caller 0x7ffef7334520 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 handle_client_reply awaiting kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 sendrecv kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 client.4749 delegated_inos: [] 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 client.4749 make_request created ino 0x1000000000e 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 make_request target is 0x1000000000e.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 lat 0.006605 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 break_deleg: breaking delegs on 0x1000000000e.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 delegations_broken: delegations empty on 0x1000000000e.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 client.4749 _create_fh 0x1000000000e mode 2 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 trim_cache size 1 max 16384 2024-03-23T23:58:21.457 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 8 client.4749 create(#0x1/AlternateNameRename_44572, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 3 client.4749 openat exit(AlternateNameRename_44572) 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 client.4749 get_quota_root realm 0x1 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 client.4749 get_quota_root 0x1000000000e.head -> 0x1.head 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 10 client.4749 cur file size is 0 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a12f5580 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- osd_op(unknown.0.0:1 3.37 3:eefe613f:::1000000000e.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a13a0e50 con 0x5611a12f5580 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- osd_op(unknown.0.0:2 3.37 3:eefe613f:::1000000000e.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1311270 con 0x5611a12f5580 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.444+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.458 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.445+0000 7f010a600640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a12f5580 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.446+0000 7f010a600640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a12f5580 0x5611a13a7dd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=2924ba012fccf4ca server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.446+0000 7f0103400640 10 client.4749 ms_handle_connect on v2:172.21.15.59:6808/1396029038 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.447+0000 7f010a600640 1 -- 172.21.15.31:0/2166537095 <== osd.7 v2:172.21.15.59:6808/1396029038 1 ==== osd_op_reply(1 1000000000e.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a12f5580 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010a600640 1 -- 172.21.15.31:0/2166537095 <== osd.7 v2:172.21.15.59:6808/1396029038 2 ==== osd_op_reply(2 1000000000e.00000000 [create] v24'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a12f5580 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 wanted_max_size 0 -> 3 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 get_caps 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 clear_suid_sgid 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 5 client.4749 get_cap_ref got first FILE_BUFFER ref on 0x1000000000e.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 5 client.4749 get_cap_ref got first FILE_CACHE ref on 0x1000000000e.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 mark_caps_dirty 0x1000000000e.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) - -> Fw 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 cap_delay_requeue on 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.459 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 get_quota_root realm 0x1 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 get_quota_root 0x1000000000e.head -> 0x1.head 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 7 client.4749 wrote to 3, extending file size 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 mark_caps_dirty 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) Fw -> Fw 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 cap_delay_requeue on 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 3 client.4749 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 3 client.4749 close enter(10) 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 8 client.4749 _release_fh 0x5611a1275330 mode 2 on 0x1000000000e.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _flush 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- osd_op(unknown.0.0:3 3.37 3:eefe613f:::1000000000e.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1310dc0 con 0x5611a12f5580 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 check_caps on 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 delaying cap release 2024-03-23T23:58:21.460 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 cap_delay_requeue on 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _release_fh 0x5611a1275330 on inode 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) no async_err state 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 3 client.4749 close exit(10) 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 path_walk 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 path_walk cur=0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 path_walk 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 may_delete 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280); ; name AlternateNameRename_44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _getattr mask As issued=1 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 3 client.4749 may_delete 0x7f00d000a280 = 0 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 may_delete 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280); ; name AlternateNameRename_445722; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.461 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _getattr mask As issued=1 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 3 client.4749 may_delete 0x7f00d000a280 = 0 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 8 client.4749 _rename(0x1 AlternateNameRename_44572 to 0x1 AlternateNameRename_445722 uid 0 gid 0) 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) name AlternateNameRename_44572 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 get_or_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) name AlternateNameRename_445722 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 15 client.4749 link dir 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 'AlternateNameRename_445722' dn 0x1.head["AlternateNameRename_445722"] (new dn) 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 _lookup have 0x1.head["AlternateNameRename_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _lookup 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) AlternateNameRename_44572 = 0x1000000000e.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 break_deleg: breaking delegs on 0x1000000000e.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 delegations_broken: delegations empty on 0x1000000000e.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 _lookup have 0x1.head["AlternateNameRename_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _do_lookup on #0x1/AlternateNameRename_445722 2024-03-23T23:58:21.462 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 choose_target_mds inode dir hash is 2 on AlternateNameRename_445722 => 3262799593 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 choose_target_mds 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=3262799593 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 mds is 0 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 encode_cap_releases enter (req: 0x5611a1311680, mds: 0) 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 send_request set sent_stamp to 2024-03-23T23:58:21.451785+0000 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 send_request client_request(unknown.0:4 lookup #0x1/AlternateNameRename_445722 2024-03-23T23:58:21.451750+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 lookup #0x1/AlternateNameRename_445722 2024-03-23T23:58:21.451750+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1311ae0 con 0x5611a127cad0 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 awaiting reply|forward|kick on 0x7ffef7334430 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_reply(???:4 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f406f620 con 0x5611a127cad0 2024-03-23T23:58:21.463 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f0103400640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f0103400640 10 client.4749 insert_trace from 2024-03-23T23:58:21.451785+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f0103400640 10 client.4749 insert_trace -- no trace 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f0103400640 20 client.4749 handle_client_reply signalling caller 0x7ffef7334430 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f0103400640 20 client.4749 handle_client_reply awaiting kickback on tid 4 0x7f01033fde80 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 sendrecv kickback on tid 4 0x7f01033fde80 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 lat 0.000955 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _do_lookup res is -2 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 _lookup 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) AlternateNameRename_445722 = -2 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 choose_target_mds inode dir hash is 2 on AlternateNameRename_445722 => 3262799593 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 choose_target_mds 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=3262799593 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.464 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 mds is 0 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 send_request rebuilding request 5 for mds.0 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 encode_cap_releases enter (req: 0x5611a13112a0, mds: 0) 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 encode_inode_release enter(in:0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860), req:0x5611a13112a0 mds:0, drop:Ls, unless:-, force:0) 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 encode_dentry_release enter(dn:0x5611a1176110) 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280), req:0x5611a13112a0 mds:0, drop:XxFs, unless:Fx, force:1) 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 encode_dentry_release enter(dn:0x7f00d000a0a0) 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280), req:0x5611a13112a0 mds:0, drop:LxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 send_request set sent_stamp to 2024-03-23T23:58:21.452801+0000 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 10 client.4749 send_request client_request(unknown.0:5 rename #0x1/AlternateNameRename_445722 (foo2) #0x1/AlternateNameRename_44572 2024-03-23T23:58:21.452762+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:5 rename #0x1/AlternateNameRename_445722 (foo2) #0x1/AlternateNameRename_44572 2024-03-23T23:58:21.452762+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1311ae0 con 0x5611a127cad0 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f010c985480 20 client.4749 awaiting reply|forward|kick on 0x7ffef7334680 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.451+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.465 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_caps(revoke ino 0x1000000000e 1 seq 2 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.438681+0000 ctime 2024-03-23T23:58:21.438681+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f408b040 con 0x5611a127cad0 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 5 client.4749 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 client.4749 mds.0 seq now 1 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 5 client.4749 handle_cap_grant on in 0x1000000000e mds.0 seq 2 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) pAsxXsxFsxcrwb ctime 2024-03-23T23:58:21.438681+0000 mtime 2024-03-23T23:58:21.438681+0000 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 client.4749 revocation of AxXx 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 client.4749 check_caps on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 client.4749 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 client.4749 completed revocation of AxXx 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 client.4749 mark_caps_flushing Fw 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.452+0000 7f0103400640 10 mark_caps_clean 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.453+0000 7f0103400640 10 client.4749 send_cap 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.453+0000 7f0103400640 15 client.4749 auth cap, requesting max_size 3 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.453+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x1000000000e 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.451483+0000 ctime 2024-03-23T23:58:21.451483+0000 change_attr 1) v12 -- 0x7f00d000ae40 con 0x5611a127cad0 2024-03-23T23:58:21.466 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.453+0000 7f0103400640 10 client.4749 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.455+0000 7f010a600640 1 -- 172.21.15.31:0/2166537095 <== osd.7 v2:172.21.15.59:6808/1396029038 3 ==== osd_op_reply(3 1000000000e.00000000 [write 0~3] v24'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a12f5580 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.455+0000 7f0100c00640 10 client.4749 _flushed 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.455+0000 7f0100c00640 5 client.4749 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.455+0000 7f0100c00640 5 client.4749 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.455+0000 7f0100c00640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 2 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.455+0000 7f0100c00640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_reply(???:5 = 0 (0) Success unsafe) v1 ==== 829+0+0 (crc 0 0 0) 0x7f00f406f810 con 0x5611a127cad0 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 handle_client_reply got a reply. Safe:0 tid 5 2024-03-23T23:58:21.471 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 insert_trace from 2024-03-23T23:58:21.452801+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 features 0xffffffffffffffff 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 update_snap_trace len 70 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref was 2 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref now is 3 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 12 client.4749 add_update_inode had 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) caps pAsLsXsFsxcrwb 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.451483+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) pAsXsFsxcrwb ctime 2024-03-23T23:58:21.452762+0000 mtime 2024-03-23T23:58:21.438681+0000 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 12 client.4749 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 add_update_cap issued pAsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000e.head(faked_ino=0 nref=14 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_44572"] 0x7f00d000a860) 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 12 client.4749 add_update_inode had 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) caps pAsLsXs 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.438681+0000 ctime=2024-03-23T23:58:21.438681+0000 change_attr=25 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) pAsLsXs ctime 2024-03-23T23:58:21.452762+0000 mtime 2024-03-23T23:58:21.452762+0000 2024-03-23T23:58:21.472 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 dir hash is 2 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 12 client.4749 add_update_inode client inode change_attr: 25 , mds inodestat change_attr: 27 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 10 client.4749 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 12 client.4749 insert_dentry_inode 'AlternateNameRename_445722' vino 0x1000000000e.head in dir 0x1.head dn 0x5611a1176110 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 15 client.4749 unlink dir 0x7f00d000a280 'AlternateNameRename_44572' dn 0x7f00d000a0a0 inode 0x7f00d000a860 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 unlink inode 0x7f00d000a860 parents now 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 15 client.4749 unlink removing 'AlternateNameRename_44572' dn 0x7f00d000a0a0 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 15 client.4749 link dir 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 'AlternateNameRename_445722' to inode 0x7f00d000a860 dn 0x1.head["AlternateNameRename_445722"] (old dn) 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 link inode 0x7f00d000a860 parents now 0x1.head["AlternateNameRename_445722"] 2024-03-23T23:58:21.473 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 15 client.4749 update_dentry_lease 0x1.head["AlternateNameRename_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.452801+0000 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 put_snap_realm 0x1 0x7f00d0007e30 3 -> 2 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 handle_client_reply signalling caller 0x7ffef7334680 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f0103400640 20 client.4749 handle_client_reply awaiting kickback on tid 5 0x7f01033fde80 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 sendrecv kickback on tid 5 0x7f01033fde80 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 make_request target is 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 lat 0.004766 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 rename result is 0 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 trim_cache size 1 max 16384 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 8 client.4749 _rename(#0x1/AlternateNameRename_44572, #0x1/AlternateNameRename_445722) = 0 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.474 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 walk: AlternateNameRename_445722 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 path_walk cur=0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 path_walk AlternateNameRename_445722 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 0 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) AlternateNameRename_445722 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 (path is AlternateNameRename_445722) 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 may_lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 _getattr mask As issued=1 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 3 client.4749 may_lookup 0x7f00d000a280 = 0 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 _lookup have 0x1.head["AlternateNameRename_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 _do_lookup on #0x1/AlternateNameRename_445722 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 choose_target_mds inode dir hash is 2 on AlternateNameRename_445722 => 3262799593 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 choose_target_mds 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) is_hash=1 hash=3262799593 2024-03-23T23:58:21.475 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 mds is 0 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 send_request rebuilding request 6 for mds.0 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 encode_cap_releases enter (req: 0x5611a1311ae0, mds: 0) 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 send_request set sent_stamp to 2024-03-23T23:58:21.457658+0000 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 10 client.4749 send_request client_request(unknown.0:6 lookup #0x1/AlternateNameRename_445722 2024-03-23T23:58:21.457635+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:6 lookup #0x1/AlternateNameRename_445722 2024-03-23T23:58:21.457635+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12ee1e0 con 0x5611a127cad0 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.457+0000 7f010c985480 20 client.4749 awaiting reply|forward|kick on 0x7ffef7334480 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:6 = 0 (0) Success) v1 ==== 829+0+0 (crc 0 0 0) 0x7f00f406fa00 con 0x5611a127cad0 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 6 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 insert_trace from 2024-03-23T23:58:21.457658+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 features 0xffffffffffffffff 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 update_snap_trace len 70 2024-03-23T23:58:21.476 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref was 2 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 get_snap_realm 0x1 0x7f00d0007e30, nref now is 3 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 12 client.4749 add_update_inode had 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) caps pAsLsXsFsxcrwb 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) pAsLsXsFsxcrwb ctime 2024-03-23T23:58:21.452762+0000 mtime 2024-03-23T23:58:21.451483+0000 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 12 client.4749 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 add_update_cap issued pAsLsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000e.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 12 client.4749 add_update_inode had 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) caps pAsLsXsFs 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 update_inode_file_time 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d000a280) pAsLsXs ctime 2024-03-23T23:58:21.452762+0000 mtime 2024-03-23T23:58:21.452762+0000 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 dir hash is 2 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 12 client.4749 add_update_inode client inode change_attr: 27 , mds inodestat change_attr: 27 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.477 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 12 client.4749 insert_dentry_inode 'AlternateNameRename_445722' vino 0x1000000000e.head in dir 0x1.head dn 0x5611a1176110 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 12 client.4749 had dentry AlternateNameRename_445722 with correct vino 0x1000000000e.head 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 15 client.4749 update_dentry_lease 0x1.head["AlternateNameRename_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.457658+0000 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_snap_realm 0x1 0x7f00d0007e30 3 -> 2 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 handle_client_reply signalling caller 0x7ffef7334480 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 handle_client_reply awaiting kickback on tid 6 0x7f01033fde80 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 sendrecv kickback on tid 6 0x7f01033fde80 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 make_request target is 0x1000000000e.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 lat 0.008015 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _do_lookup res is 0 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 _lookup have 0x1.head["AlternateNameRename_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.478 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _lookup 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) AlternateNameRename_445722 = 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 2 client.4749 unmount 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 trim_cache size 1 max 16384 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 unmounting: trim pass, size still 1+2 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 2 client.4749 unmounting 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a1310f30 con 0x5611a127cad0 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 waiting for write request '5' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.479 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_reply(???:5 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f406fbf0 con 0x5611a127cad0 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 handle_client_reply got a reply. Safe:1 tid 5 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 insert_trace from 2024-03-23T23:58:21.452801+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRename_445722"] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 trim_cache size 1 max 16384 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 15 client.4749 trim_dentry unlinking dn AlternateNameRename_445722 in dir 0x1 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 15 client.4749 unlink dir 0x7f00d000a280 'AlternateNameRename_445722' dn 0x5611a1176110 inode 0x7f00d000a860 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 unlink inode 0x7f00d000a860 parents now 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 15 client.4749 unlink removing 'AlternateNameRename_445722' dn 0x5611a1176110 2024-03-23T23:58:21.480 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 15 client.4749 close_dir dir 0x5611a124cb00 on 0x7f00d000a280 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _ll_drop_pins 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 _ll_put 0x7f00d000a280 0x1 1 -> 0 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 _release 0x1000000000e.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _invalidate_inode_cache 0x1000000000e.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _flush 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 nothing to flush 2024-03-23T23:58:21.481 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 _release 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _flush 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 nothing to flush 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 1 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 flush_caps_sync 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 wait_sync_caps want 2 (last is 2, 1 total flushing) 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 waiting on mds.0 tid 2 (want 2) 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_caps(flush_ack ino 0x1000000000e 1 seq 2 tid 2 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d000ae40 con 0x5611a127cad0 2024-03-23T23:58:21.482 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 mds.0 seq now 2 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 5 client.4749 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) with Fw 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 5 client.4749 flushing_caps Fw -> - 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) !flushing 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 1 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 unmounting: trim pass, size was 0+2 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 20 client.4749 trim_cache size 0 max 16384 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f0103400640 10 client.4749 unmounting: trim pass, size still 0+2 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 trim_cache size 0 max 16384 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) n = 24 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 15 client.4749 remove_cap last one, closing snaprealm 0x7f00d0007e30 2024-03-23T23:58:21.483 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_snap_realm 0x1 0x7f00d0007e30 2 -> 1 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=- has_dir_layout 0x7f00d000a280) 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _put_inode on 0x1000000000e.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) n = 26 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 remove_cap mds.0 on 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 15 client.4749 remove_cap last one, closing snaprealm 0x7f00d0007e30 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 20 client.4749 put_snap_realm 0x1 0x7f00d0007e30 1 -> 0 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 10 client.4749 _put_inode deleting 0x1000000000e.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.438681+0000 mtime=2024-03-23T23:58:21.451483+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=1 caps=- objectset[0x1000000000e ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d000a860) 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 2 client.4749 _close_mds_session mds.0 seq 2 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 2) v7 -- 0x5611a12ee390 con 0x5611a127cad0 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.465+0000 7f010c985480 2 client.4749 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.470+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 <== mds.0 v2:172.21.15.59:6834/3774186650 12 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12ee390 con 0x5611a127cad0 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.470+0000 7f0103400640 10 client.4749 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.470+0000 7f0103400640 5 client.4749 _closed_mds_session mds.0 seq 2 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.470+0000 7f0103400640 1 -- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a127cad0 msgr2=0x5611a13a3eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.484 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.470+0000 7f0103400640 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a127cad0 0x5611a13a3eb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f0103400640 10 client.4749 remove_session_caps mds.0 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f0103400640 10 client.4749 kick_requests_closed for mds.0 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f0103400640 10 client.4749 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f0103400640 20 client.4749 trim_cache size 0 max 16384 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f0103400640 10 client.4749 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 2 client.4749 unmounted. 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 1 client.4749 shutdown 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a12f5580 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a12f5580 0x5611a13a7dd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127eb70 msgr2=0x5611a1247e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 1 --2- 172.21.15.31:0/2166537095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a127eb70 0x5611a1247e20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x5611a12fa900 tx=0x7f00fc03e000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010a600640 1 -- 172.21.15.31:0/2166537095 reap_dead start 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 shutdown_connections 2024-03-23T23:58:21.485 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.471+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 >> 172.21.15.31:0/2166537095 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.486 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.472+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 shutdown_connections 2024-03-23T23:58:21.486 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.472+0000 7f010c985480 1 -- 172.21.15.31:0/2166537095 wait complete. 2024-03-23T23:58:21.486 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.472+0000 7f010c985480 20 client.4749 trim_cache size 0 max 16384 2024-03-23T23:58:21.486 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.AlternateNameRename (50 ms) 2024-03-23T23:58:21.487 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameRenameExistMatch 2024-03-23T23:58:21.490 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.473+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.490 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.474+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.490 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.475+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1310b30 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.490 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.475+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1311220 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.490 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.475+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.490 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.475+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0003e20 con 0x5611a139db40 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.475+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a127df40 con 0x5611a1310b30 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.475+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13a4a00 con 0x5611a1311220 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33628/0 (socket says 172.21.15.31:33628) 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 -- 172.21.15.31:0/2965431134 learned_addr learned my addr 172.21.15.31:0/2965431134 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f0103e00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1311220 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f0109c00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1310b30 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 -- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1311220 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1311220 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 -- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1310b30 msgr2=0x5611a1247e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a1310b30 0x5611a1247e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010a600640 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a139e180 con 0x5611a139db40 2024-03-23T23:58:21.491 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010c985480 10 client.4752 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a127e1a0 con 0x5611a139db40 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f0103e00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a1311220 0x5611a13a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f00fb400640 20 client.4752 tick 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f00fb400640 20 client.4752 collect_and_send_metrics 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f00fb400640 20 client.4752 collect_and_send_global_metrics 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f00fb400640 5 client.4752 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f00fb400640 20 client.4752 trim_cache size 0 max 16384 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.476+0000 7f00fb400640 20 client.4752 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010a600640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0104005c70 tx=0x7f0104040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882542476bb2165d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f0102000640 10 client.4752 ms_handle_connect on v2:172.21.15.31:3300/0 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043040 con 0x5611a139db40 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0104017440 con 0x5611a139db40 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f0104017660 con 0x5611a139db40 2024-03-23T23:58:21.492 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f0102000640 1 client.4752 handle_mds_map epoch 8 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010c985480 20 client.4752 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010c985480 10 client.4752 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010c985480 10 client.4752 _open_mds_session mds.0 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010c985480 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13b5570 0x5611a1312690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127ab70 con 0x5611a13b5570 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.477+0000 7f010c985480 10 client.4752 waiting for session to mds.0 to open 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.478+0000 7f0109c00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13b5570 0x5611a1312690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.479+0000 7f0109c00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13b5570 0x5611a1312690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77d0eb990af5285f server_cookie=bd1d7f3cc2a54a9 in_seq=0 out_seq=0 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.479+0000 7f0102000640 10 client.4752 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127ab70 con 0x5611a13b5570 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f0102000640 10 client.4752 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.493 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f0102000640 10 client.4752 renew_caps mds.0 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00e80094a0 con 0x5611a13b5570 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f0102000640 10 client.4752 connect_mds_targets for mds.0 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 10 client.4752 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 10 client.4752 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a12f4b50, mds: 0) 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.484191+0000 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.478608+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.478608+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a1240 con 0x5611a13b5570 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00e80094a0 con 0x5611a13b5570 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.483+0000 7f0102000640 10 client.4752 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.494 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc00fbb0 con 0x5611a13b5570 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.484191+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 features 0xffffffffffffffff 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 update_snap_trace len 70 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 1 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 15 client.4752 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 15 client.4752 snapc 1=[] 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 2 -> 1 2024-03-23T23:58:21.495 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00e80097b0) - ctime 2024-03-23T23:58:21.452762+0000 mtime 2024-03-23T23:58:21.452762+0000 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 dir hash is 2 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 27 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 12 client.4752 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=- has_dir_layout 0x7f00e80097b0) caps pAsLsXsFs 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 1 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 2 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 15 client.4752 add_update_cap first one, opened snaprealm 0x7f00e80096c0 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 10 client.4752 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 2 -> 1 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.496 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 lat 0.001411 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 _ll_get 0x7f00e80097b0 0x1 -> 1 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 3 client.4752 openat enter(AlternateNameRenameExistMatch_44572) 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 10 client.4752 path_walk AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 10 client.4752 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 (path is AlternateNameRenameExistMatch_44572) 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 10 client.4752 _getattr mask As issued=1 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 3 client.4752 may_lookup 0x7f00e80097b0 = 0 2024-03-23T23:58:21.497 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 10 client.4752 _do_lookup on #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_44572 => 2906571150 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=2906571150 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 10 client.4752 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 10 client.4752 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a13a1240, mds: 0) 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.485689+0000 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.485669+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.485669+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f7ed0 con 0x5611a13b5570 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.484+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef7334160 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc045b10 con 0x5611a13b5570 2024-03-23T23:58:21.498 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.485689+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f0102000640 10 client.4752 insert_trace -- no trace 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef7334160 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 lat 0.000847 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 10 client.4752 _do_lookup res is -2 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 10 client.4752 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_44572 = -2 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.499 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 10 client.4752 path_walk 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 10 client.4752 _getattr mask As issued=1 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 3 client.4752 may_create 0x7f00e80097b0 = 0 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 8 client.4752 _create(0x1 AlternateNameRenameExistMatch_44572, 0777) 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) name AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 15 open_dir 0x5611a127e020 on 0x7f00e80097b0 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 15 client.4752 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 'AlternateNameRenameExistMatch_44572' dn 0x1.head["AlternateNameRenameExistMatch_44572"] (new dn) 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_44572 => 2906571150 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=2906571150 2024-03-23T23:58:21.500 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 10 client.4752 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 10 client.4752 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a12f7ed0, mds: 0) 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 encode_dentry_release enter(dn:0x7f00d000a190) 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0), req:0x5611a12f7ed0 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.486640+0000 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_44572 (foo) 2024-03-23T23:58:21.486615+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_44572 (foo) 2024-03-23T23:58:21.486615+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f4330 con 0x5611a13b5570 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef73344c0 2024-03-23T23:58:21.501 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.485+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 859+0+0 (crc 0 0 0) 0x7f00fc023430 con 0x5611a13b5570 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.486640+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 features 0xffffffffffffffff 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 update_snap_trace len 70 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 1 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 2 2024-03-23T23:58:21.510 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) - ctime 2024-03-23T23:58:21.486615+0000 mtime 2024-03-23T23:58:21.486615+0000 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 12 client.4752 add_update_inode adding 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=- objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 2 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 3 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 15 client.4752 add_update_cap first one, opened snaprealm 0x7f00e80096c0 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) caps pAsLsXsFs 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.452762+0000 ctime=2024-03-23T23:58:21.452762+0000 change_attr=27 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) pAsLsXs ctime 2024-03-23T23:58:21.486615+0000 mtime 2024-03-23T23:58:21.486615+0000 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 dir hash is 2 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 27 , mds inodestat change_attr: 28 2024-03-23T23:58:21.511 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 10 client.4752 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 12 client.4752 insert_dentry_inode 'AlternateNameRenameExistMatch_44572' vino 0x1000000000f.head in dir 0x1.head dn 0x7f00d000a190 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 15 client.4752 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 'AlternateNameRenameExistMatch_44572' to inode 0x7f00e8009d90 dn 0x1.head["AlternateNameRenameExistMatch_44572"] (old dn) 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 link inode 0x7f00e8009d90 parents now 0x1.head["AlternateNameRenameExistMatch_44572"] 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.486640+0000 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 3 -> 2 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef73344c0 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.512 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 client.4752 delegated_inos: [] 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 client.4752 make_request created ino 0x1000000000f 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 make_request target is 0x1000000000f.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 lat 0.008117 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 break_deleg: breaking delegs on 0x1000000000f.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 delegations_broken: delegations empty on 0x1000000000f.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 client.4752 _create_fh 0x1000000000f mode 2 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 trim_cache size 1 max 16384 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 8 client.4752 create(#0x1/AlternateNameRenameExistMatch_44572, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.513 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 3 client.4752 openat exit(AlternateNameRenameExistMatch_44572) 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 client.4752 get_quota_root realm 0x1 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 client.4752 get_quota_root 0x1000000000f.head -> 0x1.head 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 10 client.4752 cur file size is 0 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a12f5580 0x5611a1276330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:1 3.12 3:49e35fbc:::1000000000f.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a12f5a00 con 0x5611a12f5580 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:2 3.12 3:49e35fbc:::1000000000f.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1272930 con 0x5611a12f5580 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.493+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.494+0000 7f0103e00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a12f5580 0x5611a1276330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.494+0000 7f0103e00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a12f5580 0x5611a1276330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=d62df7236ec406f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.494+0000 7f0102000640 10 client.4752 ms_handle_connect on v2:172.21.15.31:6809/2134439972 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.495+0000 7f0103e00640 1 -- 172.21.15.31:0/2965431134 <== osd.0 v2:172.21.15.31:6809/2134439972 1 ==== osd_op_reply(1 1000000000f.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a12f5580 2024-03-23T23:58:21.514 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f0103e00640 1 -- 172.21.15.31:0/2965431134 <== osd.0 v2:172.21.15.31:6809/2134439972 2 ==== osd_op_reply(2 1000000000f.00000000 [create] v24'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a12f5580 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 wanted_max_size 0 -> 3 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 get_caps 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 clear_suid_sgid 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 5 client.4752 get_cap_ref got first FILE_BUFFER ref on 0x1000000000f.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 5 client.4752 get_cap_ref got first FILE_CACHE ref on 0x1000000000f.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 mark_caps_dirty 0x1000000000f.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) - -> Fw 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 cap_delay_requeue on 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 get_quota_root realm 0x1 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 get_quota_root 0x1000000000f.head -> 0x1.head 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 7 client.4752 wrote to 3, extending file size 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 mark_caps_dirty 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) Fw -> Fw 2024-03-23T23:58:21.515 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 cap_delay_requeue on 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 3 client.4752 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 3 client.4752 close enter(10) 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 8 client.4752 _release_fh 0x5611a139e180 mode 2 on 0x1000000000f.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 _flush 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:3 3.12 3:49e35fbc:::1000000000f.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a12ee1e0 con 0x5611a12f5580 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 check_caps on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 delaying cap release 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 cap_delay_requeue on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 _release_fh 0x5611a139e180 on inode 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) no async_err state 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 3 client.4752 close exit(10) 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 3 client.4752 openat enter(AlternateNameRenameExistMatch_445722) 2024-03-23T23:58:21.516 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 path_walk AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 0 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 (path is AlternateNameRenameExistMatch_445722) 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 may_lookup 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 _getattr mask As issued=1 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 3 client.4752 may_lookup 0x7f00e80097b0 = 0 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 _do_lookup on #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_445722 => 1567478927 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=1567478927 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.517 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a12f4330, mds: 0) 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.500260+0000 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.500229+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.500229+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1272d80 con 0x5611a13b5570 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.499+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef7334160 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_reply(???:4 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc023620 con 0x5611a13b5570 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.500260+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f0102000640 10 client.4752 insert_trace -- no trace 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef7334160 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:21.518 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 lat 0.001022 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 10 client.4752 _do_lookup res is -2 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 10 client.4752 _lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_445722 = -2 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 10 client.4752 path_walk 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 may_create 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 10 client.4752 _getattr mask As issued=1 2024-03-23T23:58:21.519 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 3 client.4752 may_create 0x7f00e80097b0 = 0 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 8 client.4752 _create(0x1 AlternateNameRenameExistMatch_445722, 0777) 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 get_or_create 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) name AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 15 client.4752 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 'AlternateNameRenameExistMatch_445722' dn 0x1.head["AlternateNameRenameExistMatch_445722"] (new dn) 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_445722 => 1567478927 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=1567478927 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 10 client.4752 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 10 client.4752 send_request rebuilding request 5 for mds.0 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a1272d80, mds: 0) 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 encode_dentry_release enter(dn:0x5611a11a9530) 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0), req:0x5611a1272d80 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.520 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.501395+0000 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_445722 (foo2) 2024-03-23T23:58:21.501354+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMatch_445722 (foo2) 2024-03-23T23:58:21.501354+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12732a0 con 0x5611a13b5570 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef73344c0 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.500+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.502+0000 7f0103e00640 1 -- 172.21.15.31:0/2965431134 <== osd.0 v2:172.21.15.31:6809/2134439972 3 ==== osd_op_reply(3 1000000000f.00000000 [write 0~3] v24'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a12f5580 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.502+0000 7f0100c00640 10 client.4752 _flushed 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.502+0000 7f0100c00640 5 client.4752 put_cap_ref dropped last FILE_BUFFER ref on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.502+0000 7f0100c00640 5 client.4752 put_cap_ref dropped last FILE_CACHE ref on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.502+0000 7f0100c00640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 2 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.502+0000 7f0100c00640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:5 = 0 (0) Success unsafe) v1 ==== 877+0+0 (crc 0 0 0) 0x7f00fc023810 con 0x5611a13b5570 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:0 tid 5 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.501395+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.521 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 features 0xffffffffffffffff 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 update_snap_trace len 70 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 2 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 3 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) - ctime 2024-03-23T23:58:21.501354+0000 mtime 2024-03-23T23:58:21.501354+0000 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 12 client.4752 add_update_inode adding 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=- objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 3 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 4 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 15 client.4752 add_update_cap first one, opened snaprealm 0x7f00e80096c0 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.522 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) caps pAsLsXs 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.486615+0000 ctime=2024-03-23T23:58:21.486615+0000 change_attr=28 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) pAsLsXs ctime 2024-03-23T23:58:21.501354+0000 mtime 2024-03-23T23:58:21.501354+0000 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 dir hash is 2 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 28 , mds inodestat change_attr: 29 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 10 client.4752 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 12 client.4752 insert_dentry_inode 'AlternateNameRenameExistMatch_445722' vino 0x10000000010.head in dir 0x1.head dn 0x5611a11a9530 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 15 client.4752 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 'AlternateNameRenameExistMatch_445722' to inode 0x7f00e800a370 dn 0x1.head["AlternateNameRenameExistMatch_445722"] (old dn) 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 link inode 0x7f00e800a370 parents now 0x1.head["AlternateNameRenameExistMatch_445722"] 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.501395+0000 2024-03-23T23:58:21.523 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 4 -> 3 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef73344c0 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 5 0x7f0101ffde80 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 5 0x7f0101ffde80 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 delegated_inos: [0x10000000011~0x1f4] 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 make_request created ino 0x10000000010 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 make_request target is 0x10000000010.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 lat 0.003185 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000010.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000010.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 _create_fh 0x10000000010 mode 2 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 trim_cache size 2 max 16384 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 8 client.4752 create(#0x1/AlternateNameRenameExistMatch_445722, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.524 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 3 client.4752 openat exit(AlternateNameRenameExistMatch_445722) 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 get_quota_root realm 0x1 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 get_quota_root 0x10000000010.head -> 0x1.head 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 cur file size is 0 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 wanted_max_size 0 -> 3 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 get_caps 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 clear_suid_sgid 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 snaprealm snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 5 client.4752 get_cap_ref got first FILE_BUFFER ref on 0x10000000010.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 5 client.4752 get_cap_ref got first FILE_CACHE ref on 0x10000000010.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.525 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 mark_caps_dirty 0x10000000010.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) - -> Fw 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 cap_delay_requeue on 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 get_quota_root realm 0x1 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 get_quota_root 0x10000000010.head -> 0x1.head 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 7 client.4752 wrote to 3, extending file size 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 mark_caps_dirty 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) Fw -> Fw 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 cap_delay_requeue on 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 3 client.4752 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 3 client.4752 close enter(10) 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 8 client.4752 _release_fh 0x5611a139e180 mode 2 on 0x10000000010.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 _flush 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13da6c0 0x5611a13dcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.526 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- osd_op(unknown.0.0:4 3.3b 3:dde6a3df:::10000000010.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a13dcff0 con 0x5611a13da6c0 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 check_caps on 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 delaying cap release 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 cap_delay_requeue on 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 _release_fh 0x5611a139e180 on inode 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) no async_err state 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 3 client.4752 close exit(10) 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=26 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 10 client.4752 path_walk 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.503+0000 7f010c985480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 10 client.4752 path_walk 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0); ; name AlternateNameRenameExistMatch_44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.527 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 10 client.4752 _getattr mask As issued=1 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 3 client.4752 may_delete 0x7f00e80097b0 = 0 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0); ; name AlternateNameRenameExistMatch_445722; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 10 client.4752 _getattr mask As issued=1 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 3 client.4752 may_delete 0x7f00e80097b0 = 0 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 8 client.4752 _rename(0x1 AlternateNameRenameExistMatch_44572 to 0x1 AlternateNameRenameExistMatch_445722 uid 0 gid 0) 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) name AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) name AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 _lookup have 0x1.head["AlternateNameRenameExistMatch_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 10 client.4752 _do_lookup on #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_44572 => 2906571150 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=2906571150 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 10 client.4752 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.528 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 10 client.4752 send_request rebuilding request 6 for mds.0 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a13dd960, mds: 0) 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.505091+0000 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:6 lookup #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.505057+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:6 lookup #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.505057+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13dddf0 con 0x5611a13b5570 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef73343d0 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.504+0000 7f0109c00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13da6c0 0x5611a13dcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_reply(???:6 = 0 (0) Success) v1 ==== 837+0+0 (crc 0 0 0) 0x7f00fc065420 con 0x5611a13b5570 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 6 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.505091+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 features 0xffffffffffffffff 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 update_snap_trace len 70 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 3 2024-03-23T23:58:21.529 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 4 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 12 client.4752 add_update_inode had 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 0 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 add_update_cap issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 0x1000000000f.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) caps pAsLsXs 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) pAsLsXs ctime 2024-03-23T23:58:21.501354+0000 mtime 2024-03-23T23:58:21.501354+0000 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 dir hash is 2 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 29 , mds inodestat change_attr: 29 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 10 client.4752 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.530 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 12 client.4752 insert_dentry_inode 'AlternateNameRenameExistMatch_44572' vino 0x1000000000f.head in dir 0x1.head dn 0x7f00d000a190 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 12 client.4752 had dentry AlternateNameRenameExistMatch_44572 with correct vino 0x1000000000f.head 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.505091+0000 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 4 -> 3 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef73343d0 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 6 0x7f0101ffde80 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 6 0x7f0101ffde80 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 make_request target is 0x1000000000f.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 lat 0.001725 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 client.4752 _do_lookup res is 0 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 _lookup have 0x1.head["AlternateNameRenameExistMatch_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 client.4752 _lookup 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_44572 = 0x1000000000f.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.531 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 break_deleg: breaking delegs on 0x1000000000f.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f0109c00640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13da6c0 0x5611a13dcab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=85154ffd6019ea2f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 delegations_broken: delegations empty on 0x1000000000f.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 _lookup have 0x1.head["AlternateNameRenameExistMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 client.4752 _do_lookup on #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_445722 => 1567478927 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=1567478927 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 client.4752 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 client.4752 send_request rebuilding request 7 for mds.0 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a13dddf0, mds: 0) 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.506898+0000 2024-03-23T23:58:21.532 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.506869+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.506869+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13de230 con 0x5611a13b5570 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.505+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef73343d0 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.506+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.506+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.506+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.506+0000 7f0102000640 10 client.4752 ms_handle_connect on v2:172.21.15.59:6808/1396029038 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:7 = 0 (0) Success) v1 ==== 839+0+0 (crc 0 0 0) 0x7f00fc0659c0 con 0x5611a13b5570 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 7 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.506898+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 features 0xffffffffffffffff 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 update_snap_trace len 70 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 3 2024-03-23T23:58:21.533 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 4 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 12 client.4752 add_update_inode had 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 0 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 add_update_cap issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000010.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) caps pAsLsXs 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) pAsLsXs ctime 2024-03-23T23:58:21.501354+0000 mtime 2024-03-23T23:58:21.501354+0000 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 dir hash is 2 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 29 , mds inodestat change_attr: 29 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 10 client.4752 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 12 client.4752 insert_dentry_inode 'AlternateNameRenameExistMatch_445722' vino 0x10000000010.head in dir 0x1.head dn 0x5611a11a9530 2024-03-23T23:58:21.534 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 12 client.4752 had dentry AlternateNameRenameExistMatch_445722 with correct vino 0x10000000010.head 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.506898+0000 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 4 -> 3 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef73343d0 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 7 0x7f0101ffde80 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 7 0x7f0101ffde80 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 make_request target is 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 lat 0.001637 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 10 client.4752 _do_lookup res is 0 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 _lookup have 0x1.head["AlternateNameRenameExistMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 10 client.4752 _lookup 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_445722 = 0x10000000010.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.535 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_445722 => 1567478927 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=1567478927 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 10 client.4752 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 10 client.4752 send_request rebuilding request 8 for mds.0 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a13dd3f0, mds: 0) 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 encode_inode_release enter(in:0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90), req:0x5611a13dd3f0 mds:0, drop:Ls, unless:-, force:0) 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 encode_inode_release enter(in:0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370), req:0x5611a13dd3f0 mds:0, drop:Lsx, unless:-, force:0) 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 encode_dentry_release enter(dn:0x5611a11a9530) 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0), req:0x5611a13dd3f0 mds:0, drop:XxFs, unless:Fx, force:1) 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 encode_dentry_release enter(dn:0x7f00d000a190) 2024-03-23T23:58:21.536 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0), req:0x5611a13dd3f0 mds:0, drop:LxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.508615+0000 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:8 rename #0x1/AlternateNameRenameExistMatch_445722 (foo2) #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.508574+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:8 rename #0x1/AlternateNameRenameExistMatch_445722 (foo2) #0x1/AlternateNameRenameExistMatch_44572 2024-03-23T23:58:21.508574+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13de230 con 0x5611a13b5570 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef7334620 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.507+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(revoke ino 0x1000000000f 1 seq 3 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.486615+0000 ctime 2024-03-23T23:58:21.486615+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a070 con 0x5611a13b5570 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 5 client.4752 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 mds.0 seq now 1 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 5 client.4752 handle_cap_grant on in 0x1000000000f mds.0 seq 3 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) pAsxXsxFsxcrwb ctime 2024-03-23T23:58:21.486615+0000 mtime 2024-03-23T23:58:21.486615+0000 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 revocation of AxXx 2024-03-23T23:58:21.537 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 check_caps on 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) wanted - used Fc issued pAsXsFsxcrwb revoking AxXx flags=1 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 completed revocation of AxXx 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 mark_caps_flushing Fw 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 mark_caps_clean 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 send_cap 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) mds.0 seq 3 used Fc want - flush Fw retain pAsLsXsFsc held pAsxXsxFsxcrwb revoking AxXx dropping Fxrwb 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 15 client.4752 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x1000000000f 1 seq 3 tid 2 caps=pAsXsFsc dirty=Fw wanted=- follows 1 size 3/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.500025+0000 ctime 2024-03-23T23:58:21.500025+0000 change_attr 1) v12 -- 0x7f00e800a950 con 0x5611a13b5570 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 10 client.4752 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.508+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_caps(revoke ino 0x10000000010 1 seq 3 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.501354+0000 ctime 2024-03-23T23:58:21.501354+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc042040 con 0x5611a13b5570 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 mds.0 seq now 2 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 5 client.4752 handle_cap_grant on in 0x10000000010 mds.0 seq 3 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) pAsxXsxFsxcrwb ctime 2024-03-23T23:58:21.501354+0000 mtime 2024-03-23T23:58:21.501354+0000 2024-03-23T23:58:21.538 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 revocation of AxXx 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 check_caps on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 completed revocation of AxXx 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 mark_caps_flushing Fw 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 mark_caps_clean 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 send_cap 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) mds.0 seq 3 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 15 client.4752 auth cap, requesting max_size 3 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000010 1 seq 3 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.504740+0000 ctime 2024-03-23T23:58:21.504740+0000 change_attr 1) v12 -- 0x7f00fc05a070 con 0x5611a13b5570 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0102000640 10 client.4752 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0109c00640 1 -- 172.21.15.31:0/2965431134 <== osd.7 v2:172.21.15.59:6808/1396029038 1 ==== osd_op_reply(4 10000000010.00000000 [write 0~3] v24'1 uv1 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00fc06c070 con 0x5611a13da6c0 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0100c00640 10 client.4752 _flushed 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0100c00640 5 client.4752 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0100c00640 5 client.4752 put_cap_ref dropped last FILE_CACHE ref on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) 2024-03-23T23:58:21.539 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0100c00640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 2 2024-03-23T23:58:21.540 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.509+0000 7f0100c00640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.543 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.515+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 12 ==== client_caps(grant ino 0x10000000010 1 seq 4 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.504740+0000 ctime 2024-03-23T23:58:21.504740+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a070 con 0x5611a13b5570 2024-03-23T23:58:21.543 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.515+0000 7f0102000640 10 client.4752 mds.0 seq now 3 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.515+0000 7f0102000640 5 client.4752 handle_cap_grant on in 0x10000000010 mds.0 seq 4 caps now pAsXsFsxcrwb was pAsXsFsxcrwb 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.515+0000 7f0102000640 10 client.4752 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e800a370) pAsXsFsxcrwb ctime 2024-03-23T23:58:21.504740+0000 mtime 2024-03-23T23:58:21.504740+0000 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.515+0000 7f0102000640 10 client.4752 caps unchanged at pAsXsFsxcrwb 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.515+0000 7f0102000640 10 client.4752 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 13 ==== client_reply(???:8 = 0 (0) Success unsafe) v1 ==== 839+0+0 (crc 0 0 0) 0x7f00fc05bc20 con 0x5611a13b5570 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:0 tid 8 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.508615+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 features 0xffffffffffffffff 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 update_snap_trace len 70 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 3 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 4 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.544 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 12 client.4752 add_update_inode had 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) caps pAsLsXsFsxcrwb 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.500025+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) pAsXsFscw ctime 2024-03-23T23:58:21.508574+0000 mtime 2024-03-23T23:58:21.500025+0000 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 2 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 add_update_cap issued pAsXsFsc -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000f.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_44572"] 0x7f00e8009d90) 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) caps pAsLsXs 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.501354+0000 ctime=2024-03-23T23:58:21.501354+0000 change_attr=29 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) pAsLsXs ctime 2024-03-23T23:58:21.508574+0000 mtime 2024-03-23T23:58:21.508574+0000 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 dir hash is 2 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 29 , mds inodestat change_attr: 32 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 12 client.4752 insert_dentry_inode 'AlternateNameRenameExistMatch_445722' vino 0x1000000000f.head in dir 0x1.head dn 0x5611a11a9530 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 12 client.4752 had dentry AlternateNameRenameExistMatch_445722 with WRONG vino 0x10000000010.head 2024-03-23T23:58:21.545 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 15 client.4752 unlink dir 0x7f00e80097b0 'AlternateNameRenameExistMatch_445722' dn 0x5611a11a9530 inode 0x7f00e800a370 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 unlink inode 0x7f00e800a370 parents now 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 15 client.4752 unlink dir 0x7f00e80097b0 'AlternateNameRenameExistMatch_44572' dn 0x7f00d000a190 inode 0x7f00e8009d90 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 unlink inode 0x7f00e8009d90 parents now 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 15 client.4752 unlink removing 'AlternateNameRenameExistMatch_44572' dn 0x7f00d000a190 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 15 client.4752 link dir 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 'AlternateNameRenameExistMatch_445722' to inode 0x7f00e8009d90 dn 0x1.head["AlternateNameRenameExistMatch_445722"] (old dn) 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 link inode 0x7f00e8009d90 parents now 0x1.head["AlternateNameRenameExistMatch_445722"] 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.546 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.508615+0000 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 4 -> 3 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef7334620 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 8 0x7f0101ffde80 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 8 0x7f0101ffde80 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 make_request target is 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 lat 0.013824 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 rename result is 0 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 trim_cache size 1 max 16384 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 8 client.4752 _rename(#0x1/AlternateNameRenameExistMatch_44572, #0x1/AlternateNameRenameExistMatch_445722) = 0 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 walk: AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.547 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 path_walk cur=0x1.head(faked_ino=0 nref=31 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 path_walk AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 0 0x1.head(faked_ino=0 nref=31 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 (path is AlternateNameRenameExistMatch_445722) 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 may_lookup 0x1.head(faked_ino=0 nref=31 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 _getattr mask As issued=1 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 3 client.4752 may_lookup 0x7f00e80097b0 = 0 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 _lookup have 0x1.head["AlternateNameRenameExistMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 14 ==== client_reply(???:5 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc05be10 con 0x5611a13b5570 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 _do_lookup on #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMatch_445722 => 1567478927 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 choose_target_mds 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) is_hash=1 hash=1567478927 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.548 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 mds is 0 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 send_request rebuilding request 9 for mds.0 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 encode_cap_releases enter (req: 0x5611a13de230, mds: 0) 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 send_request set sent_stamp to 2024-03-23T23:58:21.522541+0000 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 10 client.4752 send_request client_request(unknown.0:9 lookup #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.522513+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:9 lookup #0x1/AlternateNameRenameExistMatch_445722 2024-03-23T23:58:21.522513+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276870 con 0x5611a13b5570 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f010c985480 20 client.4752 awaiting reply|forward|kick on 0x7ffef7334420 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 5 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.501395+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 10 client.4752 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.521+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 15 ==== client_caps(flush_ack ino 0x1000000000f 1 seq 3 tid 2 caps=pAsXsFsc dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00e800a950 con 0x5611a13b5570 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 mds.0 seq now 4 2024-03-23T23:58:21.549 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 5 client.4752 handle_cap_flush_ack mds.0 cleaned Fw on 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) with Fw 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 5 client.4752 flushing_caps Fw -> - 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) !flushing 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 16 ==== client_caps(grant ino 0x1000000000f 1 seq 5 caps=pAsLsXsFsxcrwb dirty=- wanted=- follows 0 size 3/0 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.500025+0000 ctime 2024-03-23T23:58:21.508574+0000 change_attr 2) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc022040 con 0x5611a13b5570 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 mds.0 seq now 5 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 5 client.4752 handle_cap_grant on in 0x1000000000f mds.0 seq 5 caps now pAsLsXsFsxcrwb was pAsLsXsFsxcrwb 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) pAsLsXsFsxcrwb ctime 2024-03-23T23:58:21.508574+0000 mtime 2024-03-23T23:58:21.500025+0000 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 caps unchanged at pAsLsXsFsxcrwb 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 17 ==== client_caps(flush_ack ino 0x10000000010 1 seq 3 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc0659c0 con 0x5611a13b5570 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.527+0000 7f0102000640 10 client.4752 mds.0 seq now 6 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.528+0000 7f0102000640 5 client.4752 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) with Fw 2024-03-23T23:58:21.550 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.528+0000 7f0102000640 5 client.4752 flushing_caps Fw -> - 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.528+0000 7f0102000640 10 client.4752 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) !flushing 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.528+0000 7f0102000640 10 client.4752 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.528+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.530+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 18 ==== client_reply(???:9 = 0 (0) Success) v1 ==== 839+0+0 (crc 0 0 0) 0x7f00fc01a7c0 con 0x5611a13b5570 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 9 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.522541+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 features 0xffffffffffffffff 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 update_snap_trace len 70 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref was 3 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 get_snap_realm 0x1 0x7f00e80096c0, nref now is 4 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 12 client.4752 add_update_inode had 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) caps pAsLsXsFsxcrwb 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) pAsLsXsFsxcrwb ctime 2024-03-23T23:58:21.508574+0000 mtime 2024-03-23T23:58:21.500025+0000 2024-03-23T23:58:21.551 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 2 , mds inodestat change_attr: 2 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 add_update_cap issued pAsLsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x1000000000f.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 12 client.4752 add_update_inode had 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) caps pAsLsXsFs 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 update_inode_file_time 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e80097b0) pAsLsXs ctime 2024-03-23T23:58:21.508574+0000 mtime 2024-03-23T23:58:21.508574+0000 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 dir hash is 2 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 12 client.4752 add_update_inode client inode change_attr: 32 , mds inodestat change_attr: 32 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 12 client.4752 insert_dentry_inode 'AlternateNameRenameExistMatch_445722' vino 0x1000000000f.head in dir 0x1.head dn 0x5611a11a9530 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 12 client.4752 had dentry AlternateNameRenameExistMatch_445722 with correct vino 0x1000000000f.head 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 15 client.4752 update_dentry_lease 0x1.head["AlternateNameRenameExistMatch_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.522541+0000 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 4 -> 3 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 handle_client_reply signalling caller 0x7ffef7334420 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 handle_client_reply awaiting kickback on tid 9 0x7f0101ffde80 2024-03-23T23:58:21.552 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 20 client.4752 sendrecv kickback on tid 9 0x7f0101ffde80 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 20 client.4752 make_request target is 0x1000000000f.head(faked_ino=0 nref=25 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 20 client.4752 lat 0.009798 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 10 client.4752 _do_lookup res is 0 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 20 client.4752 _lookup have 0x1.head["AlternateNameRenameExistMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 10 client.4752 _lookup 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) AlternateNameRenameExistMatch_445722 = 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 2 client.4752 unmount 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 unmounting: trim pass, size was 1+3 2024-03-23T23:58:21.553 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 20 client.4752 trim_cache size 1 max 16384 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f0102000640 10 client.4752 unmounting: trim pass, size still 1+3 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 2 client.4752 unmounting 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a12fa710 con 0x5611a13b5570 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.531+0000 7f010c985480 10 client.4752 waiting for write request '8' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 19 ==== client_caps(grant ino 0x10000000010 1 seq 5 caps=pAsLsXsFsxcrwb dirty=- wanted=LsFxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.504740+0000 ctime 2024-03-23T23:58:21.508574+0000 change_attr 2) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc01a930 con 0x5611a13b5570 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 mds.0 seq now 7 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 5 client.4752 handle_cap_grant on in 0x10000000010 mds.0 seq 5 caps now pAsLsXsFsxcrwb was pAsXsFsxcrwb 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 update_inode_file_time 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.504740+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) pAsXsFsxcrwb ctime 2024-03-23T23:58:21.508574+0000 mtime 2024-03-23T23:58:21.504740+0000 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 grant, new caps are Ls 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 5 client.4752 _try_to_trim_inode in 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 unmounting: trim pass, size was 1+3 2024-03-23T23:58:21.554 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 trim_cache size 1 max 16384 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 unmounting: trim pass, size still 1+3 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 20 ==== client_reply(???:8 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc01ac90 con 0x5611a13b5570 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 handle_client_reply got a reply. Safe:1 tid 8 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 insert_trace from 2024-03-23T23:58:21.508615+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=26 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMatch_445722"] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 5 client.4752 _try_to_trim_inode in 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 unmounting: trim pass, size was 1+3 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 trim_cache size 1 max 16384 2024-03-23T23:58:21.555 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 15 client.4752 trim_dentry unlinking dn AlternateNameRenameExistMatch_445722 in dir 0x1 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 15 client.4752 unlink dir 0x7f00e80097b0 'AlternateNameRenameExistMatch_445722' dn 0x5611a11a9530 inode 0x7f00e8009d90 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 unlink inode 0x7f00e8009d90 parents now 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 15 client.4752 unlink removing 'AlternateNameRenameExistMatch_445722' dn 0x5611a11a9530 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 15 client.4752 close_dir dir 0x5611a127e020 on 0x7f00e80097b0 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=27 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f0102000640 10 client.4752 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 10 client.4752 _ll_drop_pins 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 _ll_put 0x7f00e80097b0 0x1 1 -> 0 2024-03-23T23:58:21.556 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 _release 0x10000000010.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 10 client.4752 _invalidate_inode_cache 0x10000000010.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 10 client.4752 _flush 0x10000000010.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 10 client.4752 nothing to flush 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 _release 0x1000000000f.head(faked_ino=0 nref=28 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e8009d90) 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 10 client.4752 _invalidate_inode_cache 0x1000000000f.head(faked_ino=0 nref=28 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e8009d90) 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 10 client.4752 _flush 0x1000000000f.head(faked_ino=0 nref=29 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 10 client.4752 nothing to flush 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.532+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=29 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 _release 0x1.head(faked_ino=0 nref=34 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.557 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=34 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _flush 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 nothing to flush 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 put_inode on 0x10000000010.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) n = 1 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 put_inode on 0x1000000000f.head(faked_ino=0 nref=29 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) n = 1 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 put_inode on 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 1 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 flush_caps_sync 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 wait_sync_caps want 3 (last is 3, 0 total flushing) 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 trim_cache size 0 max 16384 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _put_inode on 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) n = 34 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 15 client.4752 remove_cap last one, closing snaprealm 0x7f00e80096c0 2024-03-23T23:58:21.558 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 3 -> 2 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=- has_dir_layout 0x7f00e80097b0) 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _put_inode on 0x1000000000f.head(faked_ino=0 nref=29 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) n = 28 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 remove_cap mds.0 on 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 15 client.4752 remove_cap last one, closing snaprealm 0x7f00e80096c0 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 2 -> 1 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _put_inode deleting 0x1000000000f.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/0 nlink=1 btime=2024-03-23T23:58:21.486615+0000 mtime=2024-03-23T23:58:21.500025+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=- objectset[0x1000000000f ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e8009d90) 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _put_inode on 0x10000000010.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) n = 18 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 remove_cap mds.0 on 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 15 client.4752 remove_cap last one, closing snaprealm 0x7f00e80096c0 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 20 client.4752 put_snap_realm 0x1 0x7f00e80096c0 1 -> 0 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 10 client.4752 _put_inode deleting 0x10000000010.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=0 btime=2024-03-23T23:58:21.501354+0000 mtime=2024-03-23T23:58:21.504740+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=2 caps=- objectset[0x10000000010 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a370) 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 2 client.4752 _close_mds_session mds.0 seq 7 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 7) v7 -- 0x5611a13dd3f0 con 0x5611a13b5570 2024-03-23T23:58:21.559 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.533+0000 7f010c985480 2 client.4752 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 <== mds.0 v2:172.21.15.59:6834/3774186650 21 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12fa710 con 0x5611a13b5570 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 10 client.4752 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 5 client.4752 _closed_mds_session mds.0 seq 7 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 1 -- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13b5570 msgr2=0x5611a1312690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13b5570 0x5611a1312690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 10 client.4752 remove_session_caps mds.0 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 10 client.4752 kick_requests_closed for mds.0 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 10 client.4752 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.560 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 20 client.4752 trim_cache size 0 max 16384 2024-03-23T23:58:21.561 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.560+0000 7f0102000640 10 client.4752 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.561 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.561+0000 7f010c985480 2 client.4752 unmounted. 2024-03-23T23:58:21.561 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.561+0000 7f010c985480 1 client.4752 shutdown 2024-03-23T23:58:21.561 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.561+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a12f5580 msgr2=0x5611a1276330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.561 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.561+0000 7f010c985480 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a12f5580 0x5611a1276330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.562 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.562+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13da6c0 msgr2=0x5611a13dcab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.562 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.562+0000 7f010c985480 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13da6c0 0x5611a13dcab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.562 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.562+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 msgr2=0x5611a13a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.562 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.562+0000 7f010c985480 1 --2- 172.21.15.31:0/2965431134 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a139db40 0x5611a13a3eb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0104005c70 tx=0x7f0104040000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.562 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.562+0000 7f010a600640 1 -- 172.21.15.31:0/2965431134 reap_dead start 2024-03-23T23:58:21.562 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.562+0000 7f010a600640 1 -- 172.21.15.31:0/2965431134 reap_dead start 2024-03-23T23:58:21.563 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.563+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 shutdown_connections 2024-03-23T23:58:21.564 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.563+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 >> 172.21.15.31:0/2965431134 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.565 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.565+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 shutdown_connections 2024-03-23T23:58:21.566 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.566+0000 7f010c985480 1 -- 172.21.15.31:0/2965431134 wait complete. 2024-03-23T23:58:21.566 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.566+0000 7f010c985480 20 client.4752 trim_cache size 0 max 16384 2024-03-23T23:58:21.566 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.AlternateNameRenameExistMatch (94 ms) 2024-03-23T23:58:21.566 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameRenameExistMisMatch 2024-03-23T23:58:21.567 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.567+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.572 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.570+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.572 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.571+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13b5570 0x5611a13a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.572+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12f4330 0x5611a13a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.573+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.573+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8007df0 con 0x5611a12f4330 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.573+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a1308b60 con 0x5611a13b5570 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.573+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a13b52c0 con 0x5611a139db40 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.573+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13b5570 0x5611a13a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.574+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13b5570 0x5611a13a3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:56332/0 (socket says 172.21.15.31:56332) 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.574+0000 7f0109c00640 1 -- 172.21.15.31:0/400369949 learned_addr learned my addr 172.21.15.31:0/400369949 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.574 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.574+0000 7f010a600640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.575 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.574+0000 7f0103e00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12f4330 0x5611a13a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.577 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.576+0000 7f0109c00640 1 -- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 msgr2=0x5611a1247e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.576+0000 7f0109c00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.576+0000 7f0109c00640 1 -- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12f4330 msgr2=0x5611a13a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.576+0000 7f0109c00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a12f4330 0x5611a13a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.576+0000 7f0109c00640 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13019d0 con 0x5611a13b5570 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.576+0000 7f0109c00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13b5570 0x5611a13a3eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000fd0 tx=0x7f00fc05a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29edb75b438b3f9c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.577+0000 7f0103400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.577+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc057040 con 0x5611a13b5570 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.578+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f00fc076070 con 0x5611a13b5570 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.578+0000 7f010c985480 10 client.4615 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.578 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.578+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,mdsmap=0+,monmap=2+}) v3 -- 0x5611a1313280 con 0x5611a13b5570 2024-03-23T23:58:21.580 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.579+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mon.1 v2:172.21.15.59:3300/0 3 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611a13130d0 con 0x5611a13b5570 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f00fc045b10 con 0x5611a13b5570 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f00faa00640 20 client.4615 tick 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f00faa00640 20 client.4615 collect_and_send_metrics 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f00faa00640 20 client.4615 collect_and_send_global_metrics 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f00faa00640 5 client.4615 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f00faa00640 20 client.4615 trim_cache size 0 max 16384 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f00faa00640 20 client.4615 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f0103400640 1 client.4615 handle_mds_map epoch 8 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f010c985480 20 client.4615 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f010c985480 10 client.4615 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f010c985480 10 client.4615 _open_mds_session mds.0 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f010c985480 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a1240 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a12fa710 con 0x5611a13a1240 2024-03-23T23:58:21.581 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f010c985480 10 client.4615 waiting for session to mds.0 to open 2024-03-23T23:58:21.582 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.581+0000 7f0103e00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a1240 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.584 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.583+0000 7f0103e00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a1240 0x5611a13a7dd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ecf07a2f8c1516e server_cookie=ea5255bc5db0007b in_seq=0 out_seq=0 2024-03-23T23:58:21.584 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.583+0000 7f0103400640 10 client.4615 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.595 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a12fa710 con 0x5611a13a1240 2024-03-23T23:58:21.595 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f0103400640 10 client.4615 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.595 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f0103400640 10 client.4615 renew_caps mds.0 2024-03-23T23:58:21.595 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00e8009e40 con 0x5611a13a1240 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f0103400640 10 client.4615 connect_mds_targets for mds.0 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 10 client.4615 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 10 client.4615 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a13130d0, mds: 0) 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.596685+0000 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.582210+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.582210+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a2f30 con 0x5611a13a1240 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.595+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00e8009e40 con 0x5611a13a1240 2024-03-23T23:58:21.596 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.598 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00f40053b0 con 0x5611a13a1240 2024-03-23T23:58:21.598 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.596685+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 features 0xffffffffffffffff 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 update_snap_trace len 70 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 1 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 15 client.4615 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 15 client.4615 snapc 1=[] 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 2 -> 1 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.599 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00e800a150) - ctime 2024-03-23T23:58:21.508574+0000 mtime 2024-03-23T23:58:21.508574+0000 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 dir hash is 2 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 32 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 12 client.4615 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=- has_dir_layout 0x7f00e800a150) caps pAsLsXsFs 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 1 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 2 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 15 client.4615 add_update_cap first one, opened snaprealm 0x7f00e800a060 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 10 client.4615 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 2 -> 1 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 1 0x7f01033fde80 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 lat 0.001143 2024-03-23T23:58:21.600 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 _ll_get 0x7f00e800a150 0x1 -> 1 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 3 client.4615 openat enter(AlternateNameRenameExistMisMatch_44572) 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=6 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 10 client.4615 path_walk AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 10 client.4615 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 (path is AlternateNameRenameExistMisMatch_44572) 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 10 client.4615 _getattr mask As issued=1 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 3 client.4615 may_lookup 0x7f00e800a150 = 0 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 10 client.4615 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_44572 => 1312394831 2024-03-23T23:58:21.601 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=1312394831 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 10 client.4615 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 10 client.4615 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a13a2f30, mds: 0) 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.597909+0000 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.597890+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.597890+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f5580 con 0x5611a13a1240 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.596+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef7334160 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f4066950 con 0x5611a13a1240 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.597909+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f0103400640 10 client.4615 insert_trace -- no trace 2024-03-23T23:58:21.602 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef7334160 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 2 0x7f01033fde80 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 lat 0.000511 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 10 client.4615 _do_lookup res is -2 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 10 client.4615 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_44572 = -2 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 10 client.4615 path_walk 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.603 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 10 client.4615 _getattr mask As issued=1 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 3 client.4615 may_create 0x7f00e800a150 = 0 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 8 client.4615 _create(0x1 AlternateNameRenameExistMisMatch_44572, 0777) 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) name AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 15 open_dir 0x5611a12f4750 on 0x7f00e800a150 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 15 client.4615 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 'AlternateNameRenameExistMisMatch_44572' dn 0x1.head["AlternateNameRenameExistMisMatch_44572"] (new dn) 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_44572 => 1312394831 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=1312394831 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 10 client.4615 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 10 client.4615 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a12f5580, mds: 0) 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 encode_dentry_release enter(dn:0x7f00d0007e30) 2024-03-23T23:58:21.604 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150), req:0x5611a12f5580 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.605 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.598496+0000 2024-03-23T23:58:21.605 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_44572 (foo) 2024-03-23T23:58:21.598478+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.605 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_44572 (foo) 2024-03-23T23:58:21.598478+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1311160 con 0x5611a13a1240 2024-03-23T23:58:21.605 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef73344c0 2024-03-23T23:58:21.605 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.597+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.609 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 862+0+0 (crc 0 0 0) 0x7f00f4052ba0 con 0x5611a13a1240 2024-03-23T23:58:21.609 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.609 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.598496+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.609 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 features 0xffffffffffffffff 2024-03-23T23:58:21.609 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 update_snap_trace len 70 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 1 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 2 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 update_inode_file_time 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) - ctime 2024-03-23T23:58:21.598478+0000 mtime 2024-03-23T23:58:21.598478+0000 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 12 client.4615 add_update_inode adding 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=- objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 2 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 3 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 15 client.4615 add_update_cap first one, opened snaprealm 0x7f00e800a060 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.610 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 12 client.4615 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) caps pAsLsXsFs 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.508574+0000 ctime=2024-03-23T23:58:21.508574+0000 change_attr=32 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) pAsLsXs ctime 2024-03-23T23:58:21.598478+0000 mtime 2024-03-23T23:58:21.598478+0000 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 dir hash is 2 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 32 , mds inodestat change_attr: 33 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 10 client.4615 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 12 client.4615 insert_dentry_inode 'AlternateNameRenameExistMisMatch_44572' vino 0x10000000205.head in dir 0x1.head dn 0x7f00d0007e30 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 15 client.4615 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 'AlternateNameRenameExistMisMatch_44572' to inode 0x7f00e800a730 dn 0x1.head["AlternateNameRenameExistMisMatch_44572"] (old dn) 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 link inode 0x7f00e800a730 parents now 0x1.head["AlternateNameRenameExistMisMatch_44572"] 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 15 client.4615 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.598496+0000 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 3 -> 2 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef73344c0 2024-03-23T23:58:21.611 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 3 0x7f01033fde80 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 client.4615 delegated_inos: [] 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 client.4615 make_request created ino 0x10000000205 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 make_request target is 0x10000000205.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 lat 0.011251 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000205.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000205.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 client.4615 _create_fh 0x10000000205 mode 2 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 trim_cache size 1 max 16384 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 8 client.4615 create(#0x1/AlternateNameRenameExistMisMatch_44572, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.612 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 3 client.4615 openat exit(AlternateNameRenameExistMisMatch_44572) 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 client.4615 get_quota_root realm 0x1 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 client.4615 get_quota_root 0x10000000205.head -> 0x1.head 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 10 client.4615 cur file size is 0 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127cad0 0x5611a1272d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:1 3.3d 3:bfcd3380:::10000000205.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1312690 con 0x5611a127cad0 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:2 3.3d 3:bfcd3380:::10000000205.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a13dcb90 con 0x5611a127cad0 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.608+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.609+0000 7f010a600640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127cad0 0x5611a1272d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.610+0000 7f0103400640 10 client.4615 ms_handle_connect on v2:172.21.15.31:6809/2134439972 2024-03-23T23:58:21.613 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.610+0000 7f010a600640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127cad0 0x5611a1272d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=f72119845fa3fd6e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.610+0000 7f010a600640 1 -- 172.21.15.31:0/400369949 <== osd.0 v2:172.21.15.31:6809/2134439972 1 ==== osd_op_reply(1 10000000205.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a127cad0 2024-03-23T23:58:21.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010a600640 1 -- 172.21.15.31:0/400369949 <== osd.0 v2:172.21.15.31:6809/2134439972 2 ==== osd_op_reply(2 10000000205.00000000 [create] v24'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a127cad0 2024-03-23T23:58:21.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 wanted_max_size 0 -> 3 2024-03-23T23:58:21.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 get_caps 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 clear_suid_sgid 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.619 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 5 client.4615 get_cap_ref got first FILE_BUFFER ref on 0x10000000205.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 5 client.4615 get_cap_ref got first FILE_CACHE ref on 0x10000000205.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 mark_caps_dirty 0x10000000205.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) - -> Fw 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 cap_delay_requeue on 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 get_quota_root realm 0x1 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 get_quota_root 0x10000000205.head -> 0x1.head 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 7 client.4615 wrote to 3, extending file size 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 mark_caps_dirty 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) Fw -> Fw 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 cap_delay_requeue on 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 3 client.4615 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 3 client.4615 close enter(10) 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 8 client.4615 _release_fh 0x5611a1311160 mode 2 on 0x10000000205.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 _flush 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- osd_op(unknown.0.0:3 3.3d 3:bfcd3380:::10000000205.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1312690 con 0x5611a127cad0 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 check_caps on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.620 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 delaying cap release 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 cap_delay_requeue on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 _release_fh 0x5611a1311160 on inode 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) no async_err state 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 3 client.4615 close exit(10) 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 3 client.4615 openat enter(AlternateNameRenameExistMisMatch_445722) 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 path_walk AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 0 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 (path is AlternateNameRenameExistMisMatch_445722) 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 may_lookup 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 _getattr mask As issued=1 2024-03-23T23:58:21.621 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 3 client.4615 may_lookup 0x7f00e800a150 = 0 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_445722 => 844431067 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=844431067 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a1312a50, mds: 0) 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.615363+0000 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.615339+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 lookup #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.615339+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1312690 con 0x5611a13a1240 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef7334160 2024-03-23T23:58:21.622 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_reply(???:4 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f406f430 con 0x5611a13a1240 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.615363+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f0103400640 10 client.4615 insert_trace -- no trace 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef7334160 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 4 0x7f01033fde80 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 4 0x7f01033fde80 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 lat 0.000600 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 _do_lookup res is -2 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 10 client.4615 _lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_445722 = -2 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.614+0000 7f010c985480 20 client.4615 path_walk cur=0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 10 client.4615 path_walk 2024-03-23T23:58:21.623 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 may_create 0x1.head(faked_ino=0 nref=24 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 10 client.4615 _getattr mask As issued=1 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 3 client.4615 may_create 0x7f00e800a150 = 0 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 8 client.4615 _create(0x1 AlternateNameRenameExistMisMatch_445722, 0777) 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 get_or_create 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) name AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 15 client.4615 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 'AlternateNameRenameExistMisMatch_445722' dn 0x1.head["AlternateNameRenameExistMisMatch_445722"] (new dn) 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_445722 => 844431067 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=844431067 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 10 client.4615 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 10 client.4615 send_request rebuilding request 5 for mds.0 2024-03-23T23:58:21.624 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a1312690, mds: 0) 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 encode_dentry_release enter(dn:0x5611a11a1e70) 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150), req:0x5611a1312690 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.616081+0000 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_445722 (foomismatch) 2024-03-23T23:58:21.616065+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:5 create owner_uid=0, owner_gid=0 #0x1/AlternateNameRenameExistMisMatch_445722 (foomismatch) 2024-03-23T23:58:21.616065+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13dc7b0 con 0x5611a13a1240 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef73344c0 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.615+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:5 = 0 (0) Success unsafe) v1 ==== 887+0+0 (crc 0 0 0) 0x7f00f406f620 con 0x5611a13a1240 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:0 tid 5 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.616081+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 features 0xffffffffffffffff 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 update_snap_trace len 70 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 2 2024-03-23T23:58:21.625 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 3 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) - ctime 2024-03-23T23:58:21.616065+0000 mtime 2024-03-23T23:58:21.616065+0000 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 12 client.4615 add_update_inode adding 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=- objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 3 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 4 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 15 client.4615 add_update_cap first one, opened snaprealm 0x7f00e800a060 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 12 client.4615 add_update_inode had 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) caps pAsLsXs 2024-03-23T23:58:21.626 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 update_inode_file_time 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.598478+0000 ctime=2024-03-23T23:58:21.598478+0000 change_attr=33 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) pAsLsXs ctime 2024-03-23T23:58:21.616065+0000 mtime 2024-03-23T23:58:21.616065+0000 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 dir hash is 2 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 33 , mds inodestat change_attr: 34 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 10 client.4615 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 12 client.4615 insert_dentry_inode 'AlternateNameRenameExistMisMatch_445722' vino 0x10000000206.head in dir 0x1.head dn 0x5611a11a1e70 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 15 client.4615 link dir 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 'AlternateNameRenameExistMisMatch_445722' to inode 0x7f00e800ad10 dn 0x1.head["AlternateNameRenameExistMisMatch_445722"] (old dn) 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 link inode 0x7f00e800ad10 parents now 0x1.head["AlternateNameRenameExistMisMatch_445722"] 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 15 client.4615 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_445722"] lease(mask 0 dur 0 altn foomismatch)) from 2024-03-23T23:58:21.616081+0000 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 4 -> 3 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef73344c0 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 5 0x7f01033fde80 2024-03-23T23:58:21.627 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 5 0x7f01033fde80 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 delegated_inos: [0x10000000207~0x1f4] 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 make_request created ino 0x10000000206 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 make_request target is 0x10000000206.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 lat 0.001544 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000206.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000206.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 _create_fh 0x10000000206 mode 2 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 trim_cache size 2 max 16384 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 8 client.4615 create(#0x1/AlternateNameRenameExistMisMatch_445722, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=25 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.628 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 3 client.4615 openat exit(AlternateNameRenameExistMisMatch_445722) 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 get_quota_root realm 0x1 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 get_quota_root 0x10000000206.head -> 0x1.head 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 cur file size is 0 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 wanted_max_size 0 -> 3 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 get_caps 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 clear_suid_sgid 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 snaprealm snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 5 client.4615 get_cap_ref got first FILE_BUFFER ref on 0x10000000206.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 5 client.4615 get_cap_ref got first FILE_CACHE ref on 0x10000000206.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 mark_caps_dirty 0x10000000206.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) - -> Fw 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 cap_delay_requeue on 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.629 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 get_quota_root realm 0x1 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 get_quota_root 0x10000000206.head -> 0x1.head 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 7 client.4615 wrote to 3, extending file size 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 mark_caps_dirty 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) Fw -> Fw 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 cap_delay_requeue on 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 3 client.4615 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 3 client.4615 close enter(10) 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 8 client.4615 _release_fh 0x5611a1311160 mode 2 on 0x10000000206.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 _flush 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a123e860 0x5611a123ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] -- osd_op(unknown.0.0:4 3.0 3:012cdbc7:::10000000206.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a123f250 con 0x5611a123e860 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 check_caps on 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.630 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 delaying cap release 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 cap_delay_requeue on 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 _release_fh 0x5611a1311160 on inode 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) no async_err state 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 3 client.4615 close exit(10) 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 path_walk cur=0x1.head(faked_ino=0 nref=26 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 path_walk 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 path_walk cur=0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 path_walk 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150); ; name AlternateNameRenameExistMisMatch_44572; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 _getattr mask As issued=1 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 3 client.4615 may_delete 0x7f00e800a150 = 0 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 may_delete 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150); ; name AlternateNameRenameExistMisMatch_445722; UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.631 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 _getattr mask As issued=1 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 3 client.4615 may_delete 0x7f00e800a150 = 0 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 8 client.4615 _rename(0x1 AlternateNameRenameExistMisMatch_44572 to 0x1 AlternateNameRenameExistMisMatch_445722 uid 0 gid 0) 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) name AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 get_or_create 0x1.head(faked_ino=0 nref=27 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) name AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_44572 => 1312394831 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=1312394831 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 send_request rebuilding request 6 for mds.0 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a123fd70, mds: 0) 2024-03-23T23:58:21.632 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.617950+0000 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:6 lookup #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.617934+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:6 lookup #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.617934+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1240200 con 0x5611a13a1240 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef73343d0 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.616+0000 7f010a600640 1 -- 172.21.15.31:0/400369949 <== osd.0 v2:172.21.15.31:6809/2134439972 3 ==== osd_op_reply(3 10000000205.00000000 [write 0~3] v24'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0104055060 con 0x5611a127cad0 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0100c00640 10 client.4615 _flushed 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0100c00640 5 client.4615 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0100c00640 5 client.4615 put_cap_ref dropped last FILE_CACHE ref on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0100c00640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 2 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0100c00640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0109c00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a123e860 0x5611a123ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_reply(???:6 = 0 (0) Success) v1 ==== 840+0+0 (crc 0 0 0) 0x7f00f406f810 con 0x5611a13a1240 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 6 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.617950+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.633 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 features 0xffffffffffffffff 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 update_snap_trace len 70 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 3 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 4 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 12 client.4615 add_update_inode had 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 0 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 add_update_cap issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000205.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 12 client.4615 add_update_inode had 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) caps pAsLsXs 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 update_inode_file_time 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) pAsLsXs ctime 2024-03-23T23:58:21.616065+0000 mtime 2024-03-23T23:58:21.616065+0000 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 dir hash is 2 2024-03-23T23:58:21.634 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 34 , mds inodestat change_attr: 34 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 10 client.4615 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 12 client.4615 insert_dentry_inode 'AlternateNameRenameExistMisMatch_44572' vino 0x10000000205.head in dir 0x1.head dn 0x7f00d0007e30 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 12 client.4615 had dentry AlternateNameRenameExistMisMatch_44572 with correct vino 0x10000000205.head 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 15 client.4615 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.617950+0000 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 4 -> 3 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef73343d0 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 6 0x7f01033fde80 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 6 0x7f01033fde80 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 make_request target is 0x10000000205.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 lat 0.000708 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 client.4615 _do_lookup res is 0 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 client.4615 _lookup 0x1.head(faked_ino=0 nref=28 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_44572 = 0x10000000205.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.635 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000205.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000205.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 client.4615 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_445722 => 844431067 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=844431067 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 client.4615 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 client.4615 send_request rebuilding request 7 for mds.0 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a1240200, mds: 0) 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.618739+0000 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.618709+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.636 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:7 lookup #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.618709+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1240640 con 0x5611a13a1240 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef73343d0 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.617+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:7 = 0 (0) Success) v1 ==== 849+0+0 (crc 0 0 0) 0x7f00f406fdc0 con 0x5611a13a1240 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 7 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.618739+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 features 0xffffffffffffffff 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 update_snap_trace len 70 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 3 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 4 2024-03-23T23:58:21.637 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0109c00640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a123e860 0x5611a123ed10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=b424b0f6592c10ba server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 12 client.4615 add_update_inode had 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 0 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 add_update_cap issued pAsxLsXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000206.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 12 client.4615 add_update_inode had 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) caps pAsLsXs 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 update_inode_file_time 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) pAsLsXs ctime 2024-03-23T23:58:21.616065+0000 mtime 2024-03-23T23:58:21.616065+0000 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 dir hash is 2 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 34 , mds inodestat change_attr: 34 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 12 client.4615 insert_dentry_inode 'AlternateNameRenameExistMisMatch_445722' vino 0x10000000206.head in dir 0x1.head dn 0x5611a11a1e70 2024-03-23T23:58:21.638 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 12 client.4615 had dentry AlternateNameRenameExistMisMatch_445722 with correct vino 0x10000000206.head 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 15 client.4615 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_445722"] lease(mask 0 dur 0 altn foomismatch)) from 2024-03-23T23:58:21.618739+0000 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 4 -> 3 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef73343d0 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 7 0x7f01033fde80 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 7 0x7f01033fde80 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 make_request target is 0x10000000206.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 lat 0.000880 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 10 client.4615 _do_lookup res is 0 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 10 client.4615 _lookup 0x1.head(faked_ino=0 nref=29 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_445722 = 0x10000000206.head(faked_ino=0 nref=15 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.639 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_445722 => 844431067 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=844431067 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 10 client.4615 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 10 client.4615 send_request rebuilding request 8 for mds.0 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a123f800, mds: 0) 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 encode_inode_release enter(in:0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730), req:0x5611a123f800 mds:0, drop:Ls, unless:-, force:0) 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 encode_inode_release enter(in:0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10), req:0x5611a123f800 mds:0, drop:Lsx, unless:-, force:0) 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 encode_dentry_release enter(dn:0x5611a11a1e70) 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150), req:0x5611a123f800 mds:0, drop:XxFs, unless:Fx, force:1) 2024-03-23T23:58:21.640 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 encode_dentry_release enter(dn:0x7f00d0007e30) 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150), req:0x5611a123f800 mds:0, drop:LxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.619742+0000 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:8 rename #0x1/AlternateNameRenameExistMisMatch_445722 (foo2) #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.619687+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:8 rename #0x1/AlternateNameRenameExistMisMatch_445722 (foo2) #0x1/AlternateNameRenameExistMisMatch_44572 2024-03-23T23:58:21.619687+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1240640 con 0x5611a13a1240 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef7334620 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.618+0000 7f0103400640 10 client.4615 ms_handle_connect on v2:172.21.15.31:6800/2615987950 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(revoke ino 0x10000000205 1 seq 3 caps=pAsXsFsxcrwb dirty=- wanted=- follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.598478+0000 ctime 2024-03-23T23:58:21.598478+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f408b040 con 0x5611a13a1240 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 5 client.4615 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.641 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 mds.0 seq now 1 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 5 client.4615 handle_cap_grant on in 0x10000000205 mds.0 seq 3 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 update_inode_file_time 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) pAsxXsxFsxcrwb ctime 2024-03-23T23:58:21.598478+0000 mtime 2024-03-23T23:58:21.598478+0000 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 revocation of AxXx 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 check_caps on 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) wanted - used Fc issued pAsXsFsxcrwb revoking AxXx flags=1 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 completed revocation of AxXx 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 mark_caps_flushing Fw 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 mark_caps_clean 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 send_cap 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) mds.0 seq 3 used Fc want - flush Fw retain pAsLsXsFsc held pAsxXsxFsxcrwb revoking AxXx dropping Fxrwb 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 15 client.4615 auth cap, reset requested_max_size due to not wanting any file write cap 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000205 1 seq 3 tid 2 caps=pAsXsFsc dirty=Fw wanted=- follows 1 size 3/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.615210+0000 ctime 2024-03-23T23:58:21.615210+0000 change_attr 1) v12 -- 0x7f00e800b2f0 con 0x5611a13a1240 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.642 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_caps(revoke ino 0x10000000206 1 seq 3 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.616065+0000 ctime 2024-03-23T23:58:21.616065+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f40825a0 con 0x5611a13a1240 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 mds.0 seq now 2 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 5 client.4615 handle_cap_grant on in 0x10000000206 mds.0 seq 3 caps now pAsXsFsxcrwb was pAsxXsxFsxcrwb 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) pAsxXsxFsxcrwb ctime 2024-03-23T23:58:21.616065+0000 mtime 2024-03-23T23:58:21.616065+0000 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 revocation of AxXx 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 check_caps on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) wanted Fxcb used Fcb issued pAsXsFsxcrwb revoking AxXx flags=1 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 cap mds.0 issued pAsXsFsxcrwb implemented pAsxXsxFsxcrwb revoking AxXx 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 completed revocation of AxXx 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 mark_caps_flushing Fw 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 mark_caps_clean 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 send_cap 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) mds.0 seq 3 used Fcb want Fxcb flush Fw retain pAsLsxXsFsxcrwbl held pAsxXsxFsxcrwb revoking AxXx dropping - 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 15 client.4615 auth cap, requesting max_size 3 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000206 1 seq 3 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.617753+0000 ctime 2024-03-23T23:58:21.617753+0000 change_attr 1) v12 -- 0x7f00f408b040 con 0x5611a13a1240 2024-03-23T23:58:21.643 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.619+0000 7f0103400640 10 client.4615 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.620+0000 7f0109c00640 1 -- 172.21.15.31:0/400369949 <== osd.1 v2:172.21.15.31:6800/2615987950 1 ==== osd_op_reply(4 10000000206.00000000 [write 0~3] v24'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00fc06c070 con 0x5611a123e860 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.620+0000 7f0100c00640 10 client.4615 _flushed 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.620+0000 7f0100c00640 5 client.4615 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.620+0000 7f0100c00640 5 client.4615 put_cap_ref dropped last FILE_CACHE ref on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.620+0000 7f0100c00640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 2 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.620+0000 7f0100c00640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 12 ==== client_caps(grant ino 0x10000000206 1 seq 4 caps=pAsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.617753+0000 ctime 2024-03-23T23:58:21.617753+0000 change_attr 1) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f408b040 con 0x5611a13a1240 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 mds.0 seq now 3 2024-03-23T23:58:21.649 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 5 client.4615 handle_cap_grant on in 0x10000000206 mds.0 seq 4 caps now pAsXsFsxcrwb was pAsXsFsxcrwb 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) pAsXsFsxcrwb ctime 2024-03-23T23:58:21.617753+0000 mtime 2024-03-23T23:58:21.617753+0000 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 caps unchanged at pAsXsFsxcrwb 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 13 ==== client_reply(???:8 = -22 (22) Invalid argument safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f4082a70 con 0x5611a13a1240 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 8 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.619742+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 insert_trace -- no trace 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef7334620 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 8 0x7f01033fde80 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 8 0x7f01033fde80 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 lat 0.006973 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 rename result is -22 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 trim_cache size 2 max 16384 2024-03-23T23:58:21.650 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 8 client.4615 _rename(#0x1/AlternateNameRenameExistMisMatch_44572, #0x1/AlternateNameRenameExistMisMatch_445722) = -22 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 walk: AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=30 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 path_walk cur=0x1.head(faked_ino=0 nref=31 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 path_walk AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 0 0x1.head(faked_ino=0 nref=31 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 (path is AlternateNameRenameExistMisMatch_445722) 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 may_lookup 0x1.head(faked_ino=0 nref=31 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 _getattr mask As issued=1 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 3 client.4615 may_lookup 0x7f00e800a150 = 0 2024-03-23T23:58:21.651 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 _do_lookup on #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 14 ==== client_reply(???:5 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00f4082ce0 con 0x5611a13a1240 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 choose_target_mds inode dir hash is 2 on AlternateNameRenameExistMisMatch_445722 => 844431067 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 choose_target_mds 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) is_hash=1 hash=844431067 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 mds is 0 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 send_request rebuilding request 9 for mds.0 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 encode_cap_releases enter (req: 0x5611a1240640, mds: 0) 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 send_request set sent_stamp to 2024-03-23T23:58:21.626827+0000 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 10 client.4615 send_request client_request(unknown.0:9 lookup #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.626808+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:9 lookup #0x1/AlternateNameRenameExistMisMatch_445722 2024-03-23T23:58:21.626808+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1276330 con 0x5611a13a1240 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f010c985480 20 client.4615 awaiting reply|forward|kick on 0x7ffef7334420 2024-03-23T23:58:21.652 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 5 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.616081+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 15 ==== client_caps(flush_ack ino 0x10000000205 1 seq 3 tid 2 caps=pAsXsFsc dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00e800b2f0 con 0x5611a13a1240 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 mds.0 seq now 4 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 5 client.4615 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) flushing_caps=Fw objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) with Fw 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 5 client.4615 flushing_caps Fw -> - 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) !flushing 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_44572"] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 16 ==== client_caps(flush_ack ino 0x10000000206 1 seq 3 tid 3 caps=pAsXsFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00f408d480 con 0x5611a13a1240 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 10 client.4615 mds.0 seq now 5 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.625+0000 7f0103400640 5 client.4615 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) with Fw 2024-03-23T23:58:21.653 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 5 client.4615 flushing_caps Fw -> - 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) !flushing 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 17 ==== client_reply(???:9 = 0 (0) Success) v1 ==== 849+0+0 (crc 0 0 0) 0x7f00f408dba0 con 0x5611a13a1240 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 handle_client_reply got a reply. Safe:1 tid 9 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 insert_trace from 2024-03-23T23:58:21.626827+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 features 0xffffffffffffffff 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 update_snap_trace len 70 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref was 3 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 get_snap_realm 0x1 0x7f00e800a060, nref now is 4 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 update_snap_trace snaprealm(0x1 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.654 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 12 client.4615 add_update_inode had 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) caps pAsLsXsFsxcrwb 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 update_inode_file_time 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsXsFsxcrwb(0=pAsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) pAsXsFsxcrwb ctime 2024-03-23T23:58:21.617753+0000 mtime 2024-03-23T23:58:21.617753+0000 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 1 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 add_update_cap issued pAsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x10000000206.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 12 client.4615 add_update_inode had 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) caps pAsLsXsFs 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 update_inode_file_time 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00e800a150) pAsLsXs ctime 2024-03-23T23:58:21.616065+0000 mtime 2024-03-23T23:58:21.616065+0000 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 dir hash is 2 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 12 client.4615 add_update_inode client inode change_attr: 34 , mds inodestat change_attr: 34 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 12 client.4615 insert_dentry_inode 'AlternateNameRenameExistMisMatch_445722' vino 0x10000000206.head in dir 0x1.head dn 0x5611a11a1e70 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 12 client.4615 had dentry AlternateNameRenameExistMisMatch_445722 with correct vino 0x10000000206.head 2024-03-23T23:58:21.655 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 update_dentry_lease 0x1.head["AlternateNameRenameExistMisMatch_445722"] lease(mask 0 dur 0 altn foomismatch)) from 2024-03-23T23:58:21.626827+0000 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 4 -> 3 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 handle_client_reply signalling caller 0x7ffef7334420 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 handle_client_reply awaiting kickback on tid 9 0x7f01033fde80 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 sendrecv kickback on tid 9 0x7f01033fde80 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 make_request target is 0x10000000206.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 lat 0.000589 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _do_lookup res is 0 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 _lookup have 0x1.head["AlternateNameRenameExistMisMatch_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _lookup 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) AlternateNameRenameExistMisMatch_445722 = 0x10000000206.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.656 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 2 client.4615 unmount 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameRenameExistMisMatch_445722"] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 unmounting: trim pass, size was 2+3 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 trim_cache size 2 max 16384 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 trim_dentry unlinking dn AlternateNameRenameExistMisMatch_44572 in dir 0x1 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 unlink dir 0x7f00e800a150 'AlternateNameRenameExistMisMatch_44572' dn 0x7f00d0007e30 inode 0x7f00e800a730 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 unlink inode 0x7f00e800a730 parents now 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 unlink removing 'AlternateNameRenameExistMisMatch_44572' dn 0x7f00d0007e30 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 trim_dentry unlinking dn AlternateNameRenameExistMisMatch_445722 in dir 0x1 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 unlink dir 0x7f00e800a150 'AlternateNameRenameExistMisMatch_445722' dn 0x5611a11a1e70 inode 0x7f00e800ad10 2024-03-23T23:58:21.657 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 unlink inode 0x7f00e800ad10 parents now 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 unlink removing 'AlternateNameRenameExistMisMatch_445722' dn 0x5611a11a1e70 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 15 client.4615 close_dir dir 0x5611a12f4750 on 0x7f00e800a150 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f0103400640 10 client.4615 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 2 client.4615 unmounting 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=32 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _ll_drop_pins 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 _ll_put 0x7f00e800a150 0x1 1 -> 0 2024-03-23T23:58:21.658 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=33 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 _release 0x10000000206.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800ad10) 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _invalidate_inode_cache 0x10000000206.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800ad10) 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _flush 0x10000000206.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 nothing to flush 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 _release 0x10000000205.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a730) 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _invalidate_inode_cache 0x10000000205.head(faked_ino=0 nref=18 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00e800a730) 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _flush 0x10000000205.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 nothing to flush 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.659 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 _release 0x1.head(faked_ino=0 nref=34 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=34 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _flush 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 nothing to flush 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x10000000206.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) n = 1 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x10000000205.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) n = 1 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_inode on 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 1 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 flush_caps_sync 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 wait_sync_caps want 3 (last is 3, 0 total flushing) 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 trim_cache size 0 max 16384 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _put_inode on 0x1.head(faked_ino=0 nref=35 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) n = 34 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.660 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 15 client.4615 remove_cap last one, closing snaprealm 0x7f00e800a060 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 3 -> 2 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=- has_dir_layout 0x7f00e800a150) 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _put_inode on 0x10000000205.head(faked_ino=0 nref=19 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) n = 18 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 remove_cap mds.0 on 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=pAsXsFsc(0=pAsXsFsc) objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 15 client.4615 remove_cap last one, closing snaprealm 0x7f00e800a060 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 2 -> 1 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _put_inode deleting 0x10000000205.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.598478+0000 mtime=2024-03-23T23:58:21.615210+0000 ctime=2024-03-23T23:58:21.615210+0000 change_attr=1 caps=- objectset[0x10000000205 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800a730) 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _put_inode on 0x10000000206.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) n = 22 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 remove_cap mds.0 on 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 15 client.4615 remove_cap last one, closing snaprealm 0x7f00e800a060 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 20 client.4615 put_snap_realm 0x1 0x7f00e800a060 1 -> 0 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 10 client.4615 _put_inode deleting 0x10000000206.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.616065+0000 mtime=2024-03-23T23:58:21.617753+0000 ctime=2024-03-23T23:58:21.617753+0000 change_attr=1 caps=- objectset[0x10000000206 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00e800ad10) 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 2 client.4615 _close_mds_session mds.0 seq 5 2024-03-23T23:58:21.661 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 5) v7 -- 0x5611a127ab70 con 0x5611a13a1240 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.626+0000 7f010c985480 2 client.4615 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.638+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 <== mds.0 v2:172.21.15.59:6834/3774186650 18 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a127ab70 con 0x5611a13a1240 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.638+0000 7f0103400640 10 client.4615 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.638+0000 7f0103400640 5 client.4615 _closed_mds_session mds.0 seq 5 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.638+0000 7f0103400640 1 -- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a1240 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.638+0000 7f0103400640 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a13a1240 0x5611a13a7dd0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.639+0000 7f0103400640 10 client.4615 remove_session_caps mds.0 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.639+0000 7f0103400640 10 client.4615 kick_requests_closed for mds.0 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.639+0000 7f0103400640 10 client.4615 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.639+0000 7f0103400640 20 client.4615 trim_cache size 0 max 16384 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.639+0000 7f0103400640 10 client.4615 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.639+0000 7f010c985480 2 client.4615 unmounted. 2024-03-23T23:58:21.662 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.639+0000 7f010c985480 1 client.4615 shutdown 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.640+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127cad0 msgr2=0x5611a1272d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.640+0000 7f010c985480 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x5611a127cad0 0x5611a1272d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.640+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a123e860 msgr2=0x5611a123ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.640+0000 7f010c985480 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x5611a123e860 0x5611a123ed10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.640+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13b5570 msgr2=0x5611a13a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.640+0000 7f010c985480 1 --2- 172.21.15.31:0/400369949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a13b5570 0x5611a13a3eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00fc000fd0 tx=0x7f00fc05a000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.640+0000 7f010a600640 1 -- 172.21.15.31:0/400369949 reap_dead start 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.642+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 shutdown_connections 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.642+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 >> 172.21.15.31:0/400369949 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.643+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 shutdown_connections 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.643+0000 7f010c985480 1 -- 172.21.15.31:0/400369949 wait complete. 2024-03-23T23:58:21.663 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.643+0000 7f010c985480 20 client.4615 trim_cache size 0 max 16384 2024-03-23T23:58:21.664 INFO:tasks.workunit.client.0.smithi031.stdout:[ OK ] TestClient.AlternateNameRenameExistMisMatch (78 ms) 2024-03-23T23:58:21.664 INFO:tasks.workunit.client.0.smithi031.stdout:[ RUN ] TestClient.AlternateNameLink 2024-03-23T23:58:21.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.645+0000 7f010c985480 1 -- start start 2024-03-23T23:58:21.665 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.646+0000 7f010c985480 1 Processor -- start 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.647+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a123f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.649+0000 7f010c985480 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13a1240 0x5611a12758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.649+0000 7f010c985480 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13b5570 0x5611a1313010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.649+0000 7f0109c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a123f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.649+0000 7f010c985480 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8006b30 con 0x5611a13a1240 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.649+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611a127a450 con 0x5611a12466d0 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.649+0000 7f010c985480 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611a127df40 con 0x5611a13b5570 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.650+0000 7f010a600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13b5570 0x5611a1313010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.650+0000 7f010a600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13b5570 0x5611a1313010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:41220/0 (socket says 172.21.15.31:41220) 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.650+0000 7f010a600640 1 -- 172.21.15.31:0/2445584113 learned_addr learned my addr 172.21.15.31:0/2445584113 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.651+0000 7f010a600640 1 -- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 msgr2=0x5611a123f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.651+0000 7f010a600640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5611a12466d0 0x5611a123f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.666 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.651+0000 7f010a600640 1 -- 172.21.15.31:0/2445584113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13a1240 msgr2=0x5611a12758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.651+0000 7f010a600640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5611a13a1240 0x5611a12758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.651+0000 7f010a600640 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611a13a8670 con 0x5611a13b5570 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f010a600640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13b5570 0x5611a1313010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x5611a124cfc0 tx=0x7f0104075000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f3a290a2a1026a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f010c985480 10 client.4508 Subscribing to map 'mdsmap' 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mdsmap=0+}) v3 -- 0x5611a1279650 con 0x5611a13b5570 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f00fb400640 20 client.4508 tick 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f00fb400640 20 client.4508 collect_and_send_metrics 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f00fb400640 20 client.4508 collect_and_send_global_metrics 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f00fb400640 5 client.4508 collect_and_send_global_metrics MDS rank 0 is not ready yet -- not sending metric 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f00fb400640 20 client.4508 trim_cache size 0 max 16384 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f00fb400640 20 client.4508 upkeep thread waiting interval 1.000000000s 2024-03-23T23:58:21.667 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.652+0000 7f0102000640 10 client.4508 ms_handle_connect on v2:172.21.15.59:3301/0 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.653+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043040 con 0x5611a13b5570 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.653+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mon.2 v2:172.21.15.59:3301/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0104024690 con 0x5611a13b5570 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mdsmap(e 8) v2 ==== 1180+0+0 (secure 0 0 0) 0x7f010401f040 con 0x5611a13b5570 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f0102000640 1 client.4508 handle_mds_map epoch 8 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f010c985480 20 client.4508 populate_metadata read hostname 'smithi031' 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f010c985480 10 client.4508 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f010c985480 20 client.4508 mds is 0 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f010c985480 10 client.4508 _open_mds_session mds.0 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f010c985480 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_open) v7 -- 0x5611a127ab70 con 0x5611a139db40 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.654+0000 7f010c985480 10 client.4508 waiting for session to mds.0 to open 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.656+0000 7f0109c00640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a1247e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.660+0000 7f0109c00640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a1247e20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5531d6c8a1520d71 server_cookie=f02507dfddbfaf37 in_seq=0 out_seq=0 2024-03-23T23:58:21.668 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.660+0000 7f0102000640 10 client.4508 ms_handle_connect on v2:172.21.15.59:6834/3774186650 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 1 ==== client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 ==== 113+0+0 (crc 0 0 0) 0x5611a127ab70 con 0x5611a139db40 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f0102000640 10 client.4508 handle_client_session client_session(open cap_auths [MDSCapAuth(readable=1, writeable=1)]) v7 from mds.0 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f0102000640 10 client.4508 renew_caps mds.0 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_renewcaps seq 1) v7 -- 0x7f00d0009670 con 0x5611a139db40 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f0102000640 10 client.4508 connect_mds_targets for mds.0 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 10 client.4508 did not get mds through better means, so chose random mds 0 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 20 client.4508 mds is 0 2024-03-23T23:58:21.675 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 10 client.4508 send_request rebuilding request 1 for mds.0 2024-03-23T23:58:21.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 20 client.4508 encode_cap_releases enter (req: 0x5611a13a4c20, mds: 0) 2024-03-23T23:58:21.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 20 client.4508 send_request set sent_stamp to 2024-03-23T23:58:21.676468+0000 2024-03-23T23:58:21.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 10 client.4508 send_request client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.655246+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:1 getattr pAsLsXsFs #0x1 2024-03-23T23:58:21.655246+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13089b0 con 0x5611a139db40 2024-03-23T23:58:21.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.675+0000 7f010c985480 20 client.4508 awaiting reply|forward|kick on 0x7ffef7334960 2024-03-23T23:58:21.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.676+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 2 ==== client_session(renewcaps seq 1) v1 ==== 28+0+0 (crc 0 0 0) 0x7f00d0009670 con 0x5611a139db40 2024-03-23T23:58:21.676 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.676+0000 7f0102000640 10 client.4508 handle_client_session client_session(renewcaps seq 1) v1 from mds.0 2024-03-23T23:58:21.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 3 ==== client_reply(???:1 = 0 (0) Success) v1 ==== 431+0+0 (crc 0 0 0) 0x7f00fc045b10 con 0x5611a139db40 2024-03-23T23:58:21.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 handle_client_reply got a reply. Safe:1 tid 1 2024-03-23T23:58:21.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 insert_trace from 2024-03-23T23:58:21.676468+0000 mds.0 is_target=1 is_dentry=0 2024-03-23T23:58:21.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 features 0xffffffffffffffff 2024-03-23T23:58:21.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 update_snap_trace len 70 2024-03-23T23:58:21.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0, nref was 0 2024-03-23T23:58:21.678 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref now is 1 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 update_snap_trace snaprealm(0x1 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 invalidate_snaprealm_and_children snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 15 client.4508 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) self|parent updated 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 15 client.4508 snapc 1=[] 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 no new snap on snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 put_snap_realm 0x1 0x7f00d0009890 2 -> 1 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 hrm is_target=1 is_dentry=0 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 update_inode_file_time 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- 0x7f00d0009980) - ctime 2024-03-23T23:58:21.616065+0000 mtime 2024-03-23T23:58:21.616065+0000 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 dir hash is 2 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 12 client.4508 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 34 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 12 client.4508 add_update_inode adding 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=- has_dir_layout 0x7f00d0009980) caps pAsLsXsFs 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref was 1 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref now is 2 2024-03-23T23:58:21.679 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 15 client.4508 add_update_cap first one, opened snaprealm 0x7f00d0009890 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 add_update_cap issued - -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=3 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 10 client.4508 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 put_snap_realm 0x1 0x7f00d0009890 2 -> 1 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 handle_client_reply signalling caller 0x7ffef7334960 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 handle_client_reply awaiting kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 sendrecv kickback on tid 1 0x7f0101ffde80 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 lat 0.002745 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 _ll_get 0x7f00d0009980 0x1 -> 1 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 3 client.4508 openat enter(AlternateNameLink_44572) 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 path_walk cur=0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 10 client.4508 path_walk AlternateNameLink_44572 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 10 client.4508 0 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) AlternateNameLink_44572 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 (path is AlternateNameLink_44572) 2024-03-23T23:58:21.680 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 may_lookup 0x1.head(faked_ino=0 nref=10 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 10 client.4508 _getattr mask As issued=1 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 3 client.4508 may_lookup 0x7f00d0009980 = 0 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 10 client.4508 _do_lookup on #0x1/AlternateNameLink_44572 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 choose_target_mds inode dir hash is 2 on AlternateNameLink_44572 => 1948581290 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 choose_target_mds 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) is_hash=1 hash=1948581290 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 10 client.4508 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 mds is 0 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 10 client.4508 send_request rebuilding request 2 for mds.0 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 encode_cap_releases enter (req: 0x5611a13a1a40, mds: 0) 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 send_request set sent_stamp to 2024-03-23T23:58:21.679264+0000 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 10 client.4508 send_request client_request(unknown.0:2 lookup #0x1/AlternateNameLink_44572 2024-03-23T23:58:21.679248+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:2 lookup #0x1/AlternateNameLink_44572 2024-03-23T23:58:21.679248+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a127e1c0 con 0x5611a139db40 2024-03-23T23:58:21.681 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f010c985480 20 client.4508 awaiting reply|forward|kick on 0x7ffef73341c0 2024-03-23T23:58:21.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.682 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.678+0000 7f0102000640 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.679+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 4 ==== client_reply(???:2 = -2 (2) No such file or directory) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc0654a0 con 0x5611a139db40 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.679+0000 7f0102000640 20 client.4508 handle_client_reply got a reply. Safe:1 tid 2 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.679+0000 7f0102000640 10 client.4508 insert_trace from 2024-03-23T23:58:21.679264+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.679+0000 7f0102000640 10 client.4508 insert_trace -- no trace 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.679+0000 7f0102000640 20 client.4508 handle_client_reply signalling caller 0x7ffef73341c0 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.679+0000 7f0102000640 20 client.4508 handle_client_reply awaiting kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 sendrecv kickback on tid 2 0x7f0101ffde80 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 lat 0.001758 2024-03-23T23:58:21.683 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 10 client.4508 _do_lookup res is -2 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 10 client.4508 _lookup 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) AlternateNameLink_44572 = -2 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=11 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 path_walk cur=0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 10 client.4508 path_walk 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 may_create 0x1.head(faked_ino=0 nref=14 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 10 client.4508 _getattr mask As issued=1 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 3 client.4508 may_create 0x7f00d0009980 = 0 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 8 client.4508 _create(0x1 AlternateNameLink_44572, 0777) 2024-03-23T23:58:21.684 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 get_or_create 0x1.head(faked_ino=0 nref=15 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) name AlternateNameLink_44572 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 15 open_dir 0x5611a12f79e0 on 0x7f00d0009980 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 15 client.4508 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 'AlternateNameLink_44572' dn 0x1.head["AlternateNameLink_44572"] (new dn) 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 choose_target_mds inode dir hash is 2 on AlternateNameLink_44572 => 1948581290 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 choose_target_mds 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) is_hash=1 hash=1948581290 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 10 client.4508 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 mds is 0 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 10 client.4508 send_request rebuilding request 3 for mds.0 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 encode_cap_releases enter (req: 0x5611a127e1c0, mds: 0) 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 encode_dentry_release enter(dn:0x7f00e80096c0) 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980), req:0x5611a127e1c0 mds:0, drop:AxXxFs, unless:Fx, force:1) 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 send_request set sent_stamp to 2024-03-23T23:58:21.681133+0000 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 10 client.4508 send_request client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameLink_44572 (foo) 2024-03-23T23:58:21.681112+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.685 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:3 create owner_uid=0, owner_gid=0 #0x1/AlternateNameLink_44572 (foo) 2024-03-23T23:58:21.681112+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a12f5580 con 0x5611a139db40 2024-03-23T23:58:21.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f010c985480 20 client.4508 awaiting reply|forward|kick on 0x7ffef7334520 2024-03-23T23:58:21.686 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.680+0000 7f0102000640 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.688 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 5 ==== client_reply(???:3 = 0 (0) Success safe) v1 ==== 847+0+0 (crc 0 0 0) 0x7f00fc065a40 con 0x5611a139db40 2024-03-23T23:58:21.688 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 handle_client_reply got a reply. Safe:1 tid 3 2024-03-23T23:58:21.688 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 insert_trace from 2024-03-23T23:58:21.681133+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.688 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 features 0xffffffffffffffff 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 update_snap_trace len 70 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref was 1 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref now is 2 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 update_snap_trace snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=0.000000 ctime=0.000000 change_attr=0 caps=- objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) - ctime 2024-03-23T23:58:21.681112+0000 mtime 2024-03-23T23:58:21.681112+0000 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 12 client.4508 add_update_inode client inode change_attr: 0 , mds inodestat change_attr: 0 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 12 client.4508 add_update_inode adding 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=- objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref was 2 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref now is 3 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 15 client.4508 add_update_cap first one, opened snaprealm 0x7f00d0009890 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 add_update_cap issued - -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={} open={} mode=100777 size=0/0 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.689 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 12 client.4508 add_update_inode had 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) caps pAsLsXsFs 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 update_inode_file_time 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.616065+0000 ctime=2024-03-23T23:58:21.616065+0000 change_attr=34 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) pAsLsXs ctime 2024-03-23T23:58:21.681112+0000 mtime 2024-03-23T23:58:21.681112+0000 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 dir hash is 2 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 12 client.4508 add_update_inode client inode change_attr: 34 , mds inodestat change_attr: 35 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 add_update_cap issued pAsLsXs -> pAsLsXsFs from mds.0 on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 10 client.4508 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 12 client.4508 insert_dentry_inode 'AlternateNameLink_44572' vino 0x10000000011.head in dir 0x1.head dn 0x7f00e80096c0 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 15 client.4508 link dir 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 'AlternateNameLink_44572' to inode 0x7f00d0009f60 dn 0x1.head["AlternateNameLink_44572"] (old dn) 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 link inode 0x7f00d0009f60 parents now 0x1.head["AlternateNameLink_44572"] 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 15 client.4508 update_dentry_lease 0x1.head["AlternateNameLink_44572"] lease(mask 0 dur 0 altn foo)) from 2024-03-23T23:58:21.681133+0000 2024-03-23T23:58:21.690 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 put_snap_realm 0x1 0x7f00d0009890 3 -> 2 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 handle_client_reply signalling caller 0x7ffef7334520 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 handle_client_reply awaiting kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 sendrecv kickback on tid 3 0x7f0101ffde80 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 client.4508 delegated_inos: [] 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 client.4508 make_request created ino 0x10000000011 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 make_request target is 0x10000000011.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 lat 0.008109 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000011.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000011.head(faked_ino=0 nref=6 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 client.4508 _create_fh 0x10000000011 mode 2 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 trim_cache size 1 max 16384 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 8 client.4508 create(#0x1/AlternateNameLink_44572, 0100777 layout 0 0 0) = 0 2024-03-23T23:58:21.691 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 3 client.4508 openat exit(AlternateNameLink_44572) 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 client.4508 get_quota_root realm 0x1 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 client.4508 get_quota_root 0x10000000011.head -> 0x1.head 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 10 client.4508 cur file size is 0 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13b5ba0 0x5611a13a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- osd_op(unknown.0.0:1 3.15 3:ab5910e2:::10000000011.00000000:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a13a3eb0 con 0x5611a13b5ba0 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- osd_op(unknown.0.0:2 3.15 3:ab5910e2:::10000000011.00000000:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a1312660 con 0x5611a13b5ba0 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.692 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.688+0000 7f0102000640 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=16 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.689+0000 7f0103e00640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13b5ba0 0x5611a13a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:21.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.690+0000 7f0103e00640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13b5ba0 0x5611a13a7dd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=a03a1aec8c957f68 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:21.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.690+0000 7f0102000640 10 client.4508 ms_handle_connect on v2:172.21.15.59:6808/1396029038 2024-03-23T23:58:21.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.690+0000 7f0103e00640 1 -- 172.21.15.31:0/2445584113 <== osd.7 v2:172.21.15.59:6808/1396029038 1 ==== osd_op_reply(1 10000000011.00000000 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a13b5ba0 2024-03-23T23:58:21.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f0103e00640 1 -- 172.21.15.31:0/2445584113 <== osd.7 v2:172.21.15.59:6808/1396029038 2 ==== osd_op_reply(2 10000000011.00000000 [create] v24'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a13b5ba0 2024-03-23T23:58:21.697 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 wanted_max_size 0 -> 3 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 get_caps 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) have pAsxLsXsxFsxcrwb need AsFw want Fb revoking - 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 clear_suid_sgid 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60); UserPerm(uid: 0, gid: 0) defer 0 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 snaprealm snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 5 client.4508 get_cap_ref got first FILE_BUFFER ref on 0x10000000011.head(faked_ino=0 nref=8 ll_ref=0 cap_refs={4=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 5 client.4508 get_cap_ref got first FILE_CACHE ref on 0x10000000011.head(faked_ino=0 nref=9 ll_ref=0 cap_refs={4=0,1024=0,4096=1,8192=0} open={2=1} mode=100777 size=0/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 mark_caps_dirty 0x10000000011.head(faked_ino=0 nref=10 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) - -> Fw 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 cap_delay_requeue on 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=0 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 get_quota_root realm 0x1 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 get_quota_root 0x10000000011.head -> 0x1.head 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 7 client.4508 wrote to 3, extending file size 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 mark_caps_dirty 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) Fw -> Fw 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 cap_delay_requeue on 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=1,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.698 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 3 client.4508 write(10, "...", 3, 0) = 3 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 3 client.4508 close enter(10) 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 8 client.4508 _release_fh 0x5611a1308b50 mode 2 on 0x10000000011.head(faked_ino=0 nref=11 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=1} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 _flush 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- osd_op(unknown.0.0:3 3.15 3:ab5910e2:::10000000011.00000000:head [write 0~3 in=3b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e24) v9 -- 0x5611a13a3eb0 con 0x5611a13b5ba0 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 check_caps on 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) wanted Fxcb used Fcb issued pAsxLsXsxFsxcrwb revoking - flags=0 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 cap mds.0 issued pAsxLsXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking - 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 delaying cap release 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 cap_delay_requeue on 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 _release_fh 0x5611a1308b50 on inode 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) no async_err state 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=12 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 3 client.4508 close exit(10) 2024-03-23T23:58:21.699 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 path_walk cur=0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 path_walk AlternateNameLink_44572 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 0 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) AlternateNameLink_44572 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 (path is AlternateNameLink_44572) 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 may_lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 _getattr mask As issued=1 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 3 client.4508 may_lookup 0x7f00d0009980 = 0 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 _lookup have 0x1.head["AlternateNameLink_44572"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 _lookup 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) AlternateNameLink_44572 = 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=17 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 path_walk cur=0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 path_walk 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 may_hardlink 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.700 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 _getattr mask As issued=1 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 3 client.4508 may_hardlink 0x7f00d0009f60 = 0 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 may_create 0x1.head(faked_ino=0 nref=18 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 _getattr mask As issued=1 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 3 client.4508 may_create 0x7f00d0009980 = 0 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 8 client.4508 _link(0x10000000011 to 0x1 AlternateNameLink_445722 uid 0 gid 0) 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 break_deleg: breaking delegs on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 delegations_broken: delegations empty on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 get_or_create 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) name AlternateNameLink_445722 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 15 client.4508 link dir 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 'AlternateNameLink_445722' dn 0x1.head["AlternateNameLink_445722"] (new dn) 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 choose_target_mds inode dir hash is 2 on AlternateNameLink_445722 => 1333095678 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 choose_target_mds 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980) is_hash=1 hash=1333095678 2024-03-23T23:58:21.701 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 choose_target_mds from dirfragtree hash 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 mds is 0 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 send_request rebuilding request 4 for mds.0 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 encode_cap_releases enter (req: 0x5611a1312a50, mds: 0) 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 encode_inode_release enter(in:0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXsFs(0=pAsLsXsFs) has_dir_layout 0x7f00d0009980), req:0x5611a1312a50 mds:0, drop:LxFs, unless:Fx, force:0) 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 send_request set sent_stamp to 2024-03-23T23:58:21.693467+0000 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 10 client.4508 send_request client_request(unknown.0:4 link #0x1/AlternateNameLink_445722 (foo2) #0x10000000011 2024-03-23T23:58:21.693427+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:4 link #0x1/AlternateNameLink_445722 (foo2) #0x10000000011 2024-03-23T23:58:21.693427+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a13a3f20 con 0x5611a139db40 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.692+0000 7f010c985480 20 client.4508 awaiting reply|forward|kick on 0x7ffef7334700 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 6 ==== client_caps(revoke ino 0x10000000011 1 seq 2 caps=pAsxXsxFsxcrwb dirty=- wanted=pAsxXsxFxwb follows 0 size 0/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.681112+0000 ctime 2024-03-23T23:58:21.681112+0000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a139db40 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 5 client.4508 set_cap_epoch_barrier epoch = 24 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 mds.0 seq now 1 2024-03-23T23:58:21.702 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 5 client.4508 handle_cap_grant on in 0x10000000011 mds.0 seq 2 caps now pAsxXsxFsxcrwb was pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) pAsxLsXsxFsxcrwb ctime 2024-03-23T23:58:21.681112+0000 mtime 2024-03-23T23:58:21.681112+0000 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 revocation of Ls 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 check_caps on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) wanted Fxcb used Fcb issued pAsxXsxFsxcrwb revoking Ls flags=1 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 cap mds.0 issued pAsxXsxFsxcrwb implemented pAsxLsXsxFsxcrwb revoking Ls 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 completed revocation of Ls 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 mark_caps_flushing Fw 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 mark_caps_clean 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) dirty_caps=Fw flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 send_cap 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) mds.0 seq 2 used Fcb want Fxcb flush Fw retain pAsxLxXsxFsxcrwbl held pAsxLsXsxFsxcrwb revoking Ls dropping - 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 15 client.4508 auth cap, requesting max_size 3 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000011 1 seq 2 tid 2 caps=pAsxXsxFsxcrwb dirty=Fw wanted=Fxcb follows 1 size 3/3 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.693265+0000 ctime 2024-03-23T23:58:21.693265+0000 change_attr 1) v12 -- 0x7f00d000a540 con 0x5611a139db40 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.693+0000 7f0102000640 10 client.4508 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 7 ==== client_reply(???:4 = 0 (0) Success unsafe) v1 ==== 827+0+0 (crc 0 0 0) 0x7f00fc05b420 con 0x5611a139db40 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 handle_client_reply got a reply. Safe:0 tid 4 2024-03-23T23:58:21.703 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 insert_trace from 2024-03-23T23:58:21.693467+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 features 0xffffffffffffffff 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 update_snap_trace len 70 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref was 2 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref now is 3 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 12 client.4508 add_update_inode had 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=1 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) caps pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693265+0000 change_attr=1 caps=pAsxXsxFsxcrwb(0=pAsxXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) pAsxXsxFsxcrwb ctime 2024-03-23T23:58:21.693427+0000 mtime 2024-03-23T23:58:21.693265+0000 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 12 client.4508 add_update_inode client inode change_attr: 1 , mds inodestat change_attr: 2 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 add_update_cap issued pAsxXsxFsxcrwb -> pAsxLsXsxFsxcrwb from mds.0 on 0x10000000011.head(faked_ino=0 nref=13 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"] 0x7f00d0009f60) 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 add_update_cap calling signal_caps_inode 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 12 client.4508 add_update_inode had 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) caps pAsLsXs 2024-03-23T23:58:21.704 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 update_inode_file_time 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.681112+0000 ctime=2024-03-23T23:58:21.681112+0000 change_attr=35 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) pAsLsXs ctime 2024-03-23T23:58:21.693427+0000 mtime 2024-03-23T23:58:21.693427+0000 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 dir hash is 2 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 12 client.4508 add_update_inode client inode change_attr: 35 , mds inodestat change_attr: 36 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 12 client.4508 insert_dentry_inode 'AlternateNameLink_445722' vino 0x10000000011.head in dir 0x1.head dn 0x5611a11780d0 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 15 client.4508 link dir 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 'AlternateNameLink_445722' to inode 0x7f00d0009f60 dn 0x1.head["AlternateNameLink_445722"] (old dn) 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 link inode 0x7f00d0009f60 parents now 0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=16 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 15 client.4508 update_dentry_lease 0x1.head["AlternateNameLink_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.693467+0000 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 put_snap_realm 0x1 0x7f00d0009890 3 -> 2 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 handle_client_reply signalling caller 0x7ffef7334700 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 20 client.4508 handle_client_reply awaiting kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:21.705 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 sendrecv kickback on tid 4 0x7f0101ffde80 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 lat 0.002113 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 link result is 0 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 trim_cache size 2 max 16384 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 8 client.4508 link(#0x10000000011, #0x1/AlternateNameLink_445722) = 0 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=19 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 walk: AlternateNameLink_445722 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 path_walk cur=0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 path_walk AlternateNameLink_445722 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 0 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) AlternateNameLink_445722 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 (path is AlternateNameLink_445722) 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 8 ==== client_caps(revoke ino 0x10000000011 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 3/4194304 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.693265+0000 ctime 2024-03-23T23:58:21.693427+0000 change_attr 2) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00d000a540 con 0x5611a139db40 2024-03-23T23:58:21.706 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 may_lookup 0x1.head(faked_ino=0 nref=20 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980); UserPerm(uid: 0, gid: 0) 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 _getattr mask As issued=1 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 3 client.4508 may_lookup 0x7f00d0009980 = 0 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 _lookup have 0x1.head["AlternateNameLink_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 _do_lookup on #0x1/AlternateNameLink_445722 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 choose_target_mds starting with req->inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 choose_target_mds inode dir hash is 2 on AlternateNameLink_445722 => 1333095678 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 choose_target_mds 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) is_hash=1 hash=1333095678 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 choose_target_mds from caps on inode 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 mds is 0 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 send_request rebuilding request 5 for mds.0 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 encode_cap_releases enter (req: 0x5611a13a3f20, mds: 0) 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 send_request set sent_stamp to 2024-03-23T23:58:21.695632+0000 2024-03-23T23:58:21.707 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 10 client.4508 send_request client_request(unknown.0:5 lookup #0x1/AlternateNameLink_445722 2024-03-23T23:58:21.695619+0000 caller_uid=0, caller_gid=0{}) v6 to mds.0 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_request(unknown.0:5 lookup #0x1/AlternateNameLink_445722 2024-03-23T23:58:21.695619+0000 caller_uid=0, caller_gid=0{}) v6 -- 0x5611a1273780 con 0x5611a139db40 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f010c985480 20 client.4508 awaiting reply|forward|kick on 0x7ffef7334480 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 mds.0 seq now 2 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0103e00640 1 -- 172.21.15.31:0/2445584113 <== osd.7 v2:172.21.15.59:6808/1396029038 3 ==== osd_op_reply(3 10000000011.00000000 [write 0~3] v24'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f00f4000bc0 con 0x5611a13b5ba0 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 5 client.4508 handle_cap_grant on in 0x10000000011 mds.0 seq 4 caps now pAsLsXsFsxcrwb was pAsxLsXsxFsxcrwb 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsxLsXsxFsxcrwb(0=pAsxLsXsxFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) pAsxLsXsxFsxcrwb ctime 2024-03-23T23:58:21.693427+0000 mtime 2024-03-23T23:58:21.693265+0000 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 revocation of AxXx 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 check_caps on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) wanted Fxcb used Fcb issued pAsLsXsFsxcrwb revoking AxXx flags=1 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 cap mds.0 issued pAsLsXsFsxcrwb implemented pAsxLsXsxFsxcrwb revoking AxXx 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 completed revocation of AxXx 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 send_cap 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 3] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) mds.0 seq 4 used Fcb want Fxcb flush - retain pAsLsxXsFsxcrwbl held pAsxLsXsxFsxcrwb revoking AxXx dropping - 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 15 client.4508 auth cap, requesting max_size 3 2024-03-23T23:58:21.708 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_caps(update ino 0x10000000011 1 seq 4 caps=pAsLsXsFsxcrwb dirty=- wanted=Fxcb follows 0 size 3/3 ts 1/18446744073709551615 mtime 2024-03-23T23:58:21.693265+0000 ctime 2024-03-23T23:58:21.693427+0000 change_attr 2) v12 -- 0x7f00fc05a040 con 0x5611a139db40 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0102000640 10 client.4508 handle_cap_grant calling signal_caps_inode 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0100c00640 10 client.4508 _flushed 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=1,4096=0,8192=1} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0100c00640 5 client.4508 put_cap_ref dropped last FILE_BUFFER ref on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0100c00640 5 client.4508 put_cap_ref dropped last FILE_CACHE ref on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0100c00640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 2 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.694+0000 7f0100c00640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 9 ==== client_reply(???:5 = 0 (0) Success) v1 ==== 827+0+0 (crc 0 0 0) 0x7f00fc05b610 con 0x5611a139db40 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 handle_client_reply got a reply. Safe:1 tid 5 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 insert_trace from 2024-03-23T23:58:21.695632+0000 mds.0 is_target=1 is_dentry=1 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 features 0xffffffffffffffff 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 update_snap_trace len 70 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref was 2 2024-03-23T23:58:21.709 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 get_snap_realm 0x1 0x7f00d0009890, nref now is 3 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 update_snap_trace snaprealm(0x1 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) seq 1 <= 1 and same parent, SKIPPING 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 hrm is_target=1 is_dentry=1 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 12 client.4508 add_update_inode had 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) caps pAsLsXsFsxcrwb 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 update_inode_file_time 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) pAsLsXsFsxcrwb ctime 2024-03-23T23:58:21.693427+0000 mtime 2024-03-23T23:58:21.693265+0000 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 12 client.4508 add_update_inode client inode change_attr: 2 , mds inodestat change_attr: 2 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 add_update_cap issued pAsLsXsFsxcrwb -> pAsLsXsFsxcrwb from mds.0 on 0x10000000011.head(faked_ino=0 nref=17 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 12 client.4508 add_update_inode had 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) caps pAsLsXs 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 update_inode_file_time 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) pAsLsXs ctime 2024-03-23T23:58:21.693427+0000 mtime 2024-03-23T23:58:21.693427+0000 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 dir hash is 2 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 12 client.4508 add_update_inode client inode change_attr: 36 , mds inodestat change_attr: 36 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 10 client.4508 add_update_cap issued pAsLsXs -> pAsLsXs from mds.0 on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 got dirfrag map for 0x1 frag * to mds 0 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 12 client.4508 insert_dentry_inode 'AlternateNameLink_445722' vino 0x10000000011.head in dir 0x1.head dn 0x5611a11780d0 2024-03-23T23:58:21.710 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 12 client.4508 had dentry AlternateNameLink_445722 with correct vino 0x10000000011.head 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 15 client.4508 update_dentry_lease 0x1.head["AlternateNameLink_445722"] lease(mask 0 dur 0 altn foo2)) from 2024-03-23T23:58:21.695632+0000 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 put_snap_realm 0x1 0x7f00d0009890 3 -> 2 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 handle_client_reply signalling caller 0x7ffef7334480 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2145-g3be9a5c9/rpm/el9/BUILD/ceph-19.0.0-2145-g3be9a5c9/src/test/client/alternate_name.cc:193: Failure 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stdout:Expected equality of these values: 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stdout: wdr.alternate_name 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stdout: Which is: "" 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stdout: altname2 2024-03-23T23:58:21.711 INFO:tasks.workunit.client.0.smithi031.stdout: Which is: "foo2" 2024-03-23T23:58:21.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 handle_client_reply awaiting kickback on tid 5 0x7f0101ffde80 2024-03-23T23:58:21.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 20 client.4508 sendrecv kickback on tid 5 0x7f0101ffde80 2024-03-23T23:58:21.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 20 client.4508 make_request target is 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) 2024-03-23T23:58:21.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 20 client.4508 lat 0.000750 2024-03-23T23:58:21.715 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 10 client.4508 _do_lookup res is 0 2024-03-23T23:58:21.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 20 client.4508 _lookup have 0x1.head["AlternateNameLink_445722"] from mds.-1 ttl 0.000000 seq 0 2024-03-23T23:58:21.717 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 10 client.4508 _lookup 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) AlternateNameLink_445722 = 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 2 client.4508 unmount 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 2 client.4508 unmounting 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_flushmdlog) v7 -- 0x5611a12fa710 con 0x5611a139db40 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.695+0000 7f010c985480 10 client.4508 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 10 ==== client_caps(flush_ack ino 0x10000000011 1 seq 2 tid 2 caps=pAsxXsxFsxcrwb dirty=Fw wanted=- follows 0 size 0/0 mtime 0.000000 ctime 0.000000 change_attr 0) v12 ==== 260+0+0 (crc 0 0 0) 0x7f00fc05a040 con 0x5611a139db40 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 mds.0 seq now 3 2024-03-23T23:58:21.718 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 5 client.4508 handle_cap_flush_ack mds.0 cleaned Fw on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) flushing_caps=Fw objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) with Fw 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 5 client.4508 flushing_caps Fw -> - 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) !flushing 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 handle_cap_flush_ack calling signal_caps_inode 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=20 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_44572"], 0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 unmounting: trim pass, size was 2+2 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 trim_cache size 2 max 16384 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 trim_dentry unlinking dn AlternateNameLink_44572 in dir 0x1 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 unlink dir 0x7f00d0009980 'AlternateNameLink_44572' dn 0x7f00e80096c0 inode 0x7f00d0009f60 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 unlink inode 0x7f00d0009f60 parents now 0x1.head["AlternateNameLink_445722"] 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 unlink removing 'AlternateNameLink_44572' dn 0x7f00e80096c0 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.719 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 waiting for write request '4' to complete, currently there are 1 outstanding read/write requests 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 11 ==== client_snap(split split=0x10000000011 tracelen=140) v1 ==== 172+0+0 (crc 0 0 0) 0x7f00fc05b9f0 con 0x5611a139db40 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 handle_snap client_snap(split split=0x10000000011 tracelen=140) v1 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 mds.0 seq now 4 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x10000000011 0, nref was 0 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x10000000011 0x7f00e80096c0, nref now is 1 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 splitting off snaprealm(0x10000000011 nref=1 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 moving 0x10000000011.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) from snaprealm(0x1 nref=2 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=2024-03-23T23:56:30.869655+0000 change_attr=0) 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_snap_realm 0x1 0x7f00d0009890 2 -> 1 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 update_snap_trace len 140 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x10000000011 0x7f00e80096c0, nref was 1 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x10000000011 0x7f00e80096c0, nref now is 2 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 update_snap_trace snaprealm(0x10000000011 nref=2 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 adjust_realm_parent snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 0x0 -> 0x3 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x3 0, nref was 0 2024-03-23T23:58:21.720 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x3 0x7f00d0006340, nref now is 2 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 invalidate_snaprealm_and_children snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 update_snap_trace snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) self|parent updated 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 snapc 1=[] 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x3 0x7f00d0006340, nref was 2 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 get_snap_realm 0x3 0x7f00d0006340, nref now is 3 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 update_snap_trace snaprealm(0x3 nref=3 c=0 seq=0 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) seq 1 > 0 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 invalidate_snaprealm_and_children snaprealm(0x3 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 invalidate_snaprealm_and_children snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=1=[] last_modified=0.000000 change_attr=0) 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 update_snap_trace snaprealm(0x3 nref=4 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=0=[] last_modified=0.000000 change_attr=0) self|parent updated 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 snapc 1=[] 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_snap_realm 0x3 0x7f00d0006340 4 -> 3 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 no new snap on snaprealm(0x3 nref=3 c=0 seq=1 parent=0x0 my_snaps=[] cached_snapc=1=[] last_modified=0.000000 change_attr=0) 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_snap_realm 0x3 0x7f00d0006340 3 -> 2 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 no new snap on snaprealm(0x10000000011 nref=3 c=1 seq=1 parent=0x3 my_snaps=[] cached_snapc=1=[] last_modified=0.000000 change_attr=0) 2024-03-23T23:58:21.721 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_snap_realm 0x10000000011 0x7f00e80096c0 3 -> 2 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_snap_realm 0x10000000011 0x7f00e80096c0 2 -> 1 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_snap_realm 0x10000000011 0x7f00e80096c0 2 -> 1 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 trim_cache size 1 max 16384 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 unmounting: trim pass, size still 1+2 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 12 ==== client_reply(???:4 = 0 (0) Success safe) v1 ==== 27+0+0 (crc 0 0 0) 0x7f00fc05bbe0 con 0x5611a139db40 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 handle_client_reply got a reply. Safe:1 tid 4 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 insert_trace from 2024-03-23T23:58:21.693467+0000 mds.0 is_target=0 is_dentry=0 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 insert_trace -- already got unsafe; ignoring 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=21 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] parents=0x1.head["AlternateNameLink_445722"] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 unmounting: trim pass, size was 1+2 2024-03-23T23:58:21.722 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 trim_cache size 1 max 16384 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 trim_dentry unlinking dn AlternateNameLink_445722 in dir 0x1 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 unlink dir 0x7f00d0009980 'AlternateNameLink_445722' dn 0x5611a11780d0 inode 0x7f00d0009f60 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 unlink inode 0x7f00d0009f60 parents now 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 unlink removing 'AlternateNameLink_445722' dn 0x5611a11780d0 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 15 client.4508 close_dir dir 0x5611a12f79e0 on 0x7f00d0009980 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f0102000640 10 client.4508 unmounting: trim pass, cache shrank, poking unmount() 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=21 ll_ref=1 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _ll_drop_pins 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 _ll_put 0x7f00d0009980 0x1 1 -> 0 2024-03-23T23:58:21.723 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=22 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 _release 0x10000000011.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d0009f60) 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _invalidate_inode_cache 0x10000000011.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 1 dirty_or_tx 0] 0x7f00d0009f60) 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _flush 0x10000000011.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 nothing to flush 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 _release 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _invalidate_inode_cache 0x1.head(faked_ino=0 nref=23 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _flush 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 nothing to flush 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x10000000011.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) n = 1 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 1 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 flush_caps_sync 2024-03-23T23:58:21.724 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 wait_sync_caps want 2 (last is 2, 0 total flushing) 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 trim_cache size 0 max 16384 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _put_inode on 0x1.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) n = 23 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 remove_cap mds.0 on 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=pAsLsXs(0=pAsLsXs) has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 15 client.4508 remove_cap last one, closing snaprealm 0x7f00d0009890 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_snap_realm 0x1 0x7f00d0009890 1 -> 0 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _put_inode deleting 0x1.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={1024=0} open={} mode=40755 size=0/0 nlink=1 btime=2024-03-23T23:56:30.869655+0000 mtime=2024-03-23T23:58:21.693427+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=36 caps=- has_dir_layout 0x7f00d0009980) 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 _put_inode on 0x10000000011.head(faked_ino=0 nref=24 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) n = 23 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 10 client.4508 remove_cap mds.0 on 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=pAsLsXsFsxcrwb(0=pAsLsXsFsxcrwb) objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 15 client.4508 remove_cap last one, closing snaprealm 0x7f00e80096c0 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_snap_realm 0x10000000011 0x7f00e80096c0 1 -> 0 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.700+0000 7f010c985480 20 client.4508 put_snap_realm 0x3 0x7f00d0006340 2 -> 1 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.701+0000 7f010c985480 10 client.4508 _put_inode deleting 0x10000000011.head(faked_ino=0 nref=1 ll_ref=0 cap_refs={4=0,1024=0,4096=0,8192=0} open={2=0} mode=100777 size=3/4194304 nlink=2 btime=2024-03-23T23:58:21.681112+0000 mtime=2024-03-23T23:58:21.693265+0000 ctime=2024-03-23T23:58:21.693427+0000 change_attr=2 caps=- objectset[0x10000000011 ts 0/0 objects 0 dirty_or_tx 0] 0x7f00d0009f60) 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.701+0000 7f010c985480 2 client.4508 _close_mds_session mds.0 seq 4 2024-03-23T23:58:21.725 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.701+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 --> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] -- client_session(request_close seq 4) v7 -- 0x5611a13b5320 con 0x5611a139db40 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.701+0000 7f010c985480 2 client.4508 waiting for 1 mds session(s) to close (timeout: 30s) 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 <== mds.0 v2:172.21.15.59:6834/3774186650 13 ==== client_session(close) v1 ==== 28+0+0 (crc 0 0 0) 0x5611a12fa710 con 0x5611a139db40 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 10 client.4508 handle_client_session client_session(close) v1 from mds.0 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 5 client.4508 _closed_mds_session mds.0 seq 4 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 1 -- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 msgr2=0x5611a1247e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6834/3774186650,v1:172.21.15.59:6835/3774186650] conn(0x5611a139db40 0x5611a1247e20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 10 client.4508 remove_session_caps mds.0 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 10 client.4508 kick_requests_closed for mds.0 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 10 client.4508 unmounting: trim pass, size was 0+0 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 20 client.4508 trim_cache size 0 max 16384 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f0102000640 10 client.4508 unmounting: trim pass, size still 0+0 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 20 client.4508 put_snap_realm 0x3 0x7f00d0006340 1 -> 0 2024-03-23T23:58:21.726 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 2 client.4508 unmounted. 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 client.4508 shutdown 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13b5ba0 msgr2=0x5611a13a7dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x5611a13b5ba0 0x5611a13a7dd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13b5570 msgr2=0x5611a1313010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 --2- 172.21.15.31:0/2445584113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5611a13b5570 0x5611a1313010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x5611a124cfc0 tx=0x7f0104075000 comp rx=0 tx=0).stop 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010a600640 1 -- 172.21.15.31:0/2445584113 reap_dead start 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 shutdown_connections 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 >> 172.21.15.31:0/2445584113 conn(0x5611a127ba60 msgr2=0x5611a127be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 shutdown_connections 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 1 -- 172.21.15.31:0/2445584113 wait complete. 2024-03-23T23:58:21.727 INFO:tasks.workunit.client.0.smithi031.stderr:2024-03-23T23:58:21.703+0000 7f010c985480 20 client.4508 trim_cache size 0 max 16384 2024-03-23T23:58:21.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:58:21.728 INFO:tasks.workunit.client.0.smithi031.stdout:[ FAILED ] TestClient.AlternateNameLink (59 ms) 2024-03-23T23:58:21.728 INFO:tasks.workunit.client.0.smithi031.stdout:[----------] 25 tests from TestClient (9098 ms total) 2024-03-23T23:58:21.728 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout:[----------] Global test environment tear-down 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout:[==========] 25 tests from 1 test suite ran. (9098 ms total) 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout:[ PASSED ] 23 tests. 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout:[ FAILED ] 2 tests, listed below: 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout:[ FAILED ] TestClient.AlternateNameSymlink 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout:[ FAILED ] TestClient.AlternateNameLink 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout: 2024-03-23T23:58:21.729 INFO:tasks.workunit.client.0.smithi031.stdout: 2 FAILED TESTS 2024-03-23T23:58:21.729 INFO:tasks.workunit:Stopping ['client/test.sh'] on client.0... 2024-03-23T23:58:21.729 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-23T23:58:22.694 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test client/test.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh' 2024-03-23T23:58:22.897 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=68e730414239455aab0fcde96e8932b1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3be9a5c9bc793e11e2800a8c0c696e8b46742033/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test client/test.sh) on smithi031 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh' 2024-03-23T23:58:22.900 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-23T23:58:22.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-23T23:58:22.909 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb13ae00640 1 Processor -- start 2024-03-23T23:58:23.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb13ae00640 1 -- start start 2024-03-23T23:58:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb13ae00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 0x7fb1340aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb13ae00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1340b7d10 con 0x7fb1340b7930 2024-03-23T23:58:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb13ae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1340b4d50 con 0x7fb134147e70 2024-03-23T23:58:23.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb13ae00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b3900 con 0x7fb1340b32c0 2024-03-23T23:58:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb139a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb1340b7930 0x7fb134147760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46690/0 (socket says 172.21.15.31:46690) 2024-03-23T23:58:23.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.132+0000 7fb139a00640 1 -- 172.21.15.31:0/3280775061 learned_addr learned my addr 172.21.15.31:0/3280775061 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb139000640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 0x7fb1340aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213941287 0 0) 0x7fb1340b7d10 con 0x7fb1340b7930 2024-03-23T23:58:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb11c003520 con 0x7fb1340b7930 2024-03-23T23:58:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637600792 0 0) 0x7fb11c003520 con 0x7fb1340b7930 2024-03-23T23:58:23.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 msgr2=0x7fb1340aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 0x7fb1340aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 >> v1:172.21.15.59:6789/0 conn(0x7fb134147e70 legacy=0x7fb1340af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340b3b50 con 0x7fb1340b7930 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fb128001670 con 0x7fb1340b7930 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 >> v1:172.21.15.31:6789/0 conn(0x7fb1340b7930 legacy=0x7fb134147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 0x7fb11c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb11c004020 0x7fb11c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004d90 0x7fb11c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b3900 con 0x7fb11c004020 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c00bca0 con 0x7fb11c004d90 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.133+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c00bea0 con 0x7fb1340b32c0 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139000640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb11c004020 0x7fb11c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139a00640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 0x7fb11c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb13a400640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004d90 0x7fb11c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139000640 1 -- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 msgr2=0x7fb11c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:23.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139000640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 0x7fb11c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139000640 1 -- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004d90 msgr2=0x7fb11c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139000640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004d90 0x7fb11c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139000640 1 -- 172.21.15.31:0/3280775061 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c003520 con 0x7fb11c004020 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb13a400640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004d90 0x7fb11c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.134+0000 7fb139a00640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340b32c0 0x7fb11c003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.135+0000 7fb139000640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb11c004020 0x7fb11c004800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb120009ac0 tx=0x7fb11c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5a206610a49f86 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.135+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120039070 con 0x7fb11c004020 2024-03-23T23:58:23.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.135+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12002c6b0 con 0x7fb11c004020 2024-03-23T23:58:23.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.135+0000 7fb133e00640 1 -- 172.21.15.31:0/3280775061 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120009690 con 0x7fb11c004020 2024-03-23T23:58:23.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.136+0000 7fb13ae00640 1 -- 172.21.15.31:0/3280775061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb11c004020 msgr2=0x7fb11c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.136+0000 7fb13ae00640 1 --2- 172.21.15.31:0/3280775061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb11c004020 0x7fb11c004800 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb120009ac0 tx=0x7fb11c005830 comp rx=0 tx=0).stop 2024-03-23T23:58:23.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.136+0000 7fb13a400640 1 -- 172.21.15.31:0/3280775061 reap_dead start 2024-03-23T23:58:23.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.136+0000 7fb13ae00640 1 -- 172.21.15.31:0/3280775061 shutdown_connections 2024-03-23T23:58:23.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.136+0000 7fb13ae00640 1 -- 172.21.15.31:0/3280775061 >> 172.21.15.31:0/3280775061 conn(0x7fb13406cf40 msgr2=0x7fb13406ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.136+0000 7fb13ae00640 1 -- 172.21.15.31:0/3280775061 shutdown_connections 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.136+0000 7fb13ae00640 1 -- 172.21.15.31:0/3280775061 wait complete. 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.139+0000 7fb13ae00640 1 Processor -- start 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.139+0000 7fb13ae00640 1 -- start start 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004020 0x7fb13406f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340719c0 0x7fb1340b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb134070630 0x7fb134070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b51f0 con 0x7fb134070630 2024-03-23T23:58:23.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b49d0 con 0x7fb11c004020 2024-03-23T23:58:23.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1340b5370 con 0x7fb1340719c0 2024-03-23T23:58:23.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb134070630 0x7fb134070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb134070630 0x7fb134070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33656/0 (socket says 172.21.15.31:33656) 2024-03-23T23:58:23.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 -- 172.21.15.31:0/1561430074 learned_addr learned my addr 172.21.15.31:0/1561430074 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:23.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb139a00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004020 0x7fb13406f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb139000640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340719c0 0x7fb1340b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 -- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340719c0 msgr2=0x7fb1340b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340719c0 0x7fb1340b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 -- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004020 msgr2=0x7fb13406f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004020 0x7fb13406f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 -- 172.21.15.31:0/1561430074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13406ee40 con 0x7fb134070630 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13a400640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb134070630 0x7fb134070ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb1340b6160 tx=0x7fb12c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb131600640 1 -- 172.21.15.31:0/1561430074 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c018070 con 0x7fb134070630 2024-03-23T23:58:23.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb131600640 1 -- 172.21.15.31:0/1561430074 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c003b90 con 0x7fb134070630 2024-03-23T23:58:23.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb131600640 1 -- 172.21.15.31:0/1561430074 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c005070 con 0x7fb134070630 2024-03-23T23:58:23.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13406f120 con 0x7fb134070630 2024-03-23T23:58:23.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.140+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1341450d0 con 0x7fb134070630 2024-03-23T23:58:23.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.141+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1340752c0 con 0x7fb134070630 2024-03-23T23:58:23.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.142+0000 7fb131600640 1 -- 172.21.15.31:0/1561430074 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb12c01b070 con 0x7fb134070630 2024-03-23T23:58:23.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.143+0000 7fb131600640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb11406bc00 0x7fb11406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.143+0000 7fb131600640 1 -- 172.21.15.31:0/1561430074 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7fb12c08a2b0 con 0x7fb134070630 2024-03-23T23:58:23.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.144+0000 7fb139a00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb11406bc00 0x7fb11406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.145+0000 7fb139a00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb11406bc00 0x7fb11406e0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb128000ff0 tx=0x7fb128009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:23.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.148+0000 7fb131600640 1 -- 172.21.15.31:0/1561430074 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fb12c058cf0 con 0x7fb134070630 2024-03-23T23:58:23.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.348+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb134098750 con 0x7fb11406bc00 2024-03-23T23:58:23.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.371+0000 7fb131600640 1 -- 172.21.15.31:0/1561430074 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251981 (secure 0 0 0) 0x7fb134098750 con 0x7fb11406bc00 2024-03-23T23:58:23.375 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:58:23.376 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:58:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb11406bc00 msgr2=0x7fb11406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb11406bc00 0x7fb11406e0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb128000ff0 tx=0x7fb128009040 comp rx=0 tx=0).stop 2024-03-23T23:58:23.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb134070630 msgr2=0x7fb134070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb134070630 0x7fb134070ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb1340b6160 tx=0x7fb12c00dc00 comp rx=0 tx=0).stop 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 shutdown_connections 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb11406bc00 0x7fb11406e0c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb134070630 0x7fb134070ac0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1340719c0 0x7fb1340b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 --2- 172.21.15.31:0/1561430074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb11c004020 0x7fb13406f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 >> 172.21.15.31:0/1561430074 conn(0x7fb13406cf40 msgr2=0x7fb134099100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:23.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.377+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 shutdown_connections 2024-03-23T23:58:23.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.378+0000 7fb13ae00640 1 -- 172.21.15.31:0/1561430074 wait complete. 2024-03-23T23:58:23.399 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-03-23T23:58:21.360382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658650,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":123,"num_read_kb":107,"num_write":287,"num_write_kb":2546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3344,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3424256,"data_stored":2068484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":83,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003822"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595965+0000","last_change":"2024-03-23T23:56:30.885878+0000","last_active":"2024-03-23T23:58:16.595965+0000","last_peered":"2024-03-23T23:58:16.595965+0000","last_clean":"2024-03-23T23:58:16.595965+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:58:16.595965+0000","last_undegraded":"2024-03-23T23:58:16.595965+0000","last_fullsized":"2024-03-23T23:58:16.595965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594966+0000","last_change":"2024-03-23T23:56:30.875303+0000","last_active":"2024-03-23T23:58:16.594966+0000","last_peered":"2024-03-23T23:58:16.594966+0000","last_clean":"2024-03-23T23:58:16.594966+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:58:16.594966+0000","last_undegraded":"2024-03-23T23:58:16.594966+0000","last_fullsized":"2024-03-23T23:58:16.594966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595393+0000","last_change":"2024-03-23T23:56:30.883893+0000","last_active":"2024-03-23T23:58:16.595393+0000","last_peered":"2024-03-23T23:58:16.595393+0000","last_clean":"2024-03-23T23:58:16.595393+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:58:16.595393+0000","last_undegraded":"2024-03-23T23:58:16.595393+0000","last_fullsized":"2024-03-23T23:58:16.595393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593882+0000","last_change":"2024-03-23T23:56:30.891008+0000","last_active":"2024-03-23T23:58:16.593882+0000","last_peered":"2024-03-23T23:58:16.593882+0000","last_clean":"2024-03-23T23:58:16.593882+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:58:16.593882+0000","last_undegraded":"2024-03-23T23:58:16.593882+0000","last_fullsized":"2024-03-23T23:58:16.593882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595756+0000","last_change":"2024-03-23T23:56:30.877242+0000","last_active":"2024-03-23T23:58:16.595756+0000","last_peered":"2024-03-23T23:58:16.595756+0000","last_clean":"2024-03-23T23:58:16.595756+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:58:16.595756+0000","last_undegraded":"2024-03-23T23:58:16.595756+0000","last_fullsized":"2024-03-23T23:58:16.595756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593683+0000","last_change":"2024-03-23T23:56:30.890268+0000","last_active":"2024-03-23T23:58:16.593683+0000","last_peered":"2024-03-23T23:58:16.593683+0000","last_clean":"2024-03-23T23:58:16.593683+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:58:16.593683+0000","last_undegraded":"2024-03-23T23:58:16.593683+0000","last_fullsized":"2024-03-23T23:58:16.593683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595327+0000","last_change":"2024-03-23T23:56:30.885059+0000","last_active":"2024-03-23T23:58:16.595327+0000","last_peered":"2024-03-23T23:58:16.595327+0000","last_clean":"2024-03-23T23:58:16.595327+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:58:16.595327+0000","last_undegraded":"2024-03-23T23:58:16.595327+0000","last_fullsized":"2024-03-23T23:58:16.595327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577052+0000","last_change":"2024-03-23T23:56:30.881077+0000","last_active":"2024-03-23T23:58:16.577052+0000","last_peered":"2024-03-23T23:58:16.577052+0000","last_clean":"2024-03-23T23:58:16.577052+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:58:16.577052+0000","last_undegraded":"2024-03-23T23:58:16.577052+0000","last_fullsized":"2024-03-23T23:58:16.577052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596322+0000","last_change":"2024-03-23T23:56:30.883587+0000","last_active":"2024-03-23T23:58:16.596322+0000","last_peered":"2024-03-23T23:58:16.596322+0000","last_clean":"2024-03-23T23:58:16.596322+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:58:16.596322+0000","last_undegraded":"2024-03-23T23:58:16.596322+0000","last_fullsized":"2024-03-23T23:58:16.596322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569767+0000","last_change":"2024-03-23T23:56:30.888454+0000","last_active":"2024-03-23T23:58:16.569767+0000","last_peered":"2024-03-23T23:58:16.569767+0000","last_clean":"2024-03-23T23:58:16.569767+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:58:16.569767+0000","last_undegraded":"2024-03-23T23:58:16.569767+0000","last_fullsized":"2024-03-23T23:58:16.569767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569177+0000","last_change":"2024-03-23T23:56:30.881125+0000","last_active":"2024-03-23T23:58:16.569177+0000","last_peered":"2024-03-23T23:58:16.569177+0000","last_clean":"2024-03-23T23:58:16.569177+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:58:16.569177+0000","last_undegraded":"2024-03-23T23:58:16.569177+0000","last_fullsized":"2024-03-23T23:58:16.569177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571428+0000","last_change":"2024-03-23T23:56:30.863287+0000","last_active":"2024-03-23T23:58:16.571428+0000","last_peered":"2024-03-23T23:58:16.571428+0000","last_clean":"2024-03-23T23:58:16.571428+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:58:16.571428+0000","last_undegraded":"2024-03-23T23:58:16.571428+0000","last_fullsized":"2024-03-23T23:58:16.571428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:00.178139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577989+0000","last_change":"2024-03-23T23:56:30.881169+0000","last_active":"2024-03-23T23:58:16.577989+0000","last_peered":"2024-03-23T23:58:16.577989+0000","last_clean":"2024-03-23T23:58:16.577989+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:58:16.577989+0000","last_undegraded":"2024-03-23T23:58:16.577989+0000","last_fullsized":"2024-03-23T23:58:16.577989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'2","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594573+0000","last_change":"2024-03-23T23:56:30.876653+0000","last_active":"2024-03-23T23:58:16.594573+0000","last_peered":"2024-03-23T23:58:16.594573+0000","last_clean":"2024-03-23T23:58:16.594573+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:58:16.594573+0000","last_undegraded":"2024-03-23T23:58:16.594573+0000","last_fullsized":"2024-03-23T23:58:16.594573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:58:31.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594270+0000","last_change":"2024-03-23T23:56:30.862687+0000","last_active":"2024-03-23T23:58:16.594270+0000","last_peered":"2024-03-23T23:58:16.594270+0000","last_clean":"2024-03-23T23:58:16.594270+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:58:16.594270+0000","last_undegraded":"2024-03-23T23:58:16.594270+0000","last_fullsized":"2024-03-23T23:58:16.594270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593485+0000","last_change":"2024-03-23T23:56:30.882976+0000","last_active":"2024-03-23T23:58:16.593485+0000","last_peered":"2024-03-23T23:58:16.593485+0000","last_clean":"2024-03-23T23:58:16.593485+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:58:16.593485+0000","last_undegraded":"2024-03-23T23:58:16.593485+0000","last_fullsized":"2024-03-23T23:58:16.593485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595393+0000","last_change":"2024-03-23T23:56:30.895060+0000","last_active":"2024-03-23T23:58:16.595393+0000","last_peered":"2024-03-23T23:58:16.595393+0000","last_clean":"2024-03-23T23:58:16.595393+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:58:16.595393+0000","last_undegraded":"2024-03-23T23:58:16.595393+0000","last_fullsized":"2024-03-23T23:58:16.595393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566792+0000","last_change":"2024-03-23T23:56:30.892332+0000","last_active":"2024-03-23T23:58:16.566792+0000","last_peered":"2024-03-23T23:58:16.566792+0000","last_clean":"2024-03-23T23:58:16.566792+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:58:16.566792+0000","last_undegraded":"2024-03-23T23:58:16.566792+0000","last_fullsized":"2024-03-23T23:58:16.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596924+0000","last_change":"2024-03-23T23:56:30.881290+0000","last_active":"2024-03-23T23:58:16.596924+0000","last_peered":"2024-03-23T23:58:16.596924+0000","last_clean":"2024-03-23T23:58:16.596924+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:58:16.596924+0000","last_undegraded":"2024-03-23T23:58:16.596924+0000","last_fullsized":"2024-03-23T23:58:16.596924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:54:18.265054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568869+0000","last_change":"2024-03-23T23:56:30.875425+0000","last_active":"2024-03-23T23:58:16.568869+0000","last_peered":"2024-03-23T23:58:16.568869+0000","last_clean":"2024-03-23T23:58:16.568869+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:58:16.568869+0000","last_undegraded":"2024-03-23T23:58:16.568869+0000","last_fullsized":"2024-03-23T23:58:16.568869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595497+0000","last_change":"2024-03-23T23:56:30.884434+0000","last_active":"2024-03-23T23:58:16.595497+0000","last_peered":"2024-03-23T23:58:16.595497+0000","last_clean":"2024-03-23T23:58:16.595497+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:58:16.595497+0000","last_undegraded":"2024-03-23T23:58:16.595497+0000","last_fullsized":"2024-03-23T23:58:16.595497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566046+0000","last_change":"2024-03-23T23:57:11.230601+0000","last_active":"2024-03-23T23:58:16.566046+0000","last_peered":"2024-03-23T23:58:16.566046+0000","last_clean":"2024-03-23T23:58:16.566046+0000","last_became_active":"2024-03-23T23:57:11.229498+0000","last_became_peered":"2024-03-23T23:57:11.229498+0000","last_unstale":"2024-03-23T23:58:16.566046+0000","last_undegraded":"2024-03-23T23:58:16.566046+0000","last_fullsized":"2024-03-23T23:58:16.566046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577112+0000","last_change":"2024-03-23T23:56:30.888046+0000","last_active":"2024-03-23T23:58:16.577112+0000","last_peered":"2024-03-23T23:58:16.577112+0000","last_clean":"2024-03-23T23:58:16.577112+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:58:16.577112+0000","last_undegraded":"2024-03-23T23:58:16.577112+0000","last_fullsized":"2024-03-23T23:58:16.577112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593652+0000","last_change":"2024-03-23T23:56:30.886470+0000","last_active":"2024-03-23T23:58:16.593652+0000","last_peered":"2024-03-23T23:58:16.593652+0000","last_clean":"2024-03-23T23:58:16.593652+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:58:16.593652+0000","last_undegraded":"2024-03-23T23:58:16.593652+0000","last_fullsized":"2024-03-23T23:58:16.593652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578500+0000","last_change":"2024-03-23T23:56:30.885446+0000","last_active":"2024-03-23T23:58:16.578500+0000","last_peered":"2024-03-23T23:58:16.578500+0000","last_clean":"2024-03-23T23:58:16.578500+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:58:16.578500+0000","last_undegraded":"2024-03-23T23:58:16.578500+0000","last_fullsized":"2024-03-23T23:58:16.578500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569912+0000","last_change":"2024-03-23T23:56:30.882609+0000","last_active":"2024-03-23T23:58:16.569912+0000","last_peered":"2024-03-23T23:58:16.569912+0000","last_clean":"2024-03-23T23:58:16.569912+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:58:16.569912+0000","last_undegraded":"2024-03-23T23:58:16.569912+0000","last_fullsized":"2024-03-23T23:58:16.569912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'2","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595435+0000","last_change":"2024-03-23T23:56:30.881031+0000","last_active":"2024-03-23T23:58:16.595435+0000","last_peered":"2024-03-23T23:58:16.595435+0000","last_clean":"2024-03-23T23:58:16.595435+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:58:16.595435+0000","last_undegraded":"2024-03-23T23:58:16.595435+0000","last_fullsized":"2024-03-23T23:58:16.595435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577895+0000","last_change":"2024-03-23T23:56:30.887942+0000","last_active":"2024-03-23T23:58:16.577895+0000","last_peered":"2024-03-23T23:58:16.577895+0000","last_clean":"2024-03-23T23:58:16.577895+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:58:16.577895+0000","last_undegraded":"2024-03-23T23:58:16.577895+0000","last_fullsized":"2024-03-23T23:58:16.577895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595661+0000","last_change":"2024-03-23T23:56:30.882527+0000","last_active":"2024-03-23T23:58:16.595661+0000","last_peered":"2024-03-23T23:58:16.595661+0000","last_clean":"2024-03-23T23:58:16.595661+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:58:16.595661+0000","last_undegraded":"2024-03-23T23:58:16.595661+0000","last_fullsized":"2024-03-23T23:58:16.595661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593754+0000","last_change":"2024-03-23T23:56:30.885451+0000","last_active":"2024-03-23T23:58:16.593754+0000","last_peered":"2024-03-23T23:58:16.593754+0000","last_clean":"2024-03-23T23:58:16.593754+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:58:16.593754+0000","last_undegraded":"2024-03-23T23:58:16.593754+0000","last_fullsized":"2024-03-23T23:58:16.593754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.565795+0000","last_change":"2024-03-23T23:56:30.880152+0000","last_active":"2024-03-23T23:58:16.565795+0000","last_peered":"2024-03-23T23:58:16.565795+0000","last_clean":"2024-03-23T23:58:16.565795+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:58:16.565795+0000","last_undegraded":"2024-03-23T23:58:16.565795+0000","last_fullsized":"2024-03-23T23:58:16.565795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:17.288541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.567816+0000","last_change":"2024-03-23T23:56:30.880378+0000","last_active":"2024-03-23T23:58:16.567816+0000","last_peered":"2024-03-23T23:58:16.567816+0000","last_clean":"2024-03-23T23:58:16.567816+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:58:16.567816+0000","last_undegraded":"2024-03-23T23:58:16.567816+0000","last_fullsized":"2024-03-23T23:58:16.567816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.570223+0000","last_change":"2024-03-23T23:56:30.869148+0000","last_active":"2024-03-23T23:58:16.570223+0000","last_peered":"2024-03-23T23:58:16.570223+0000","last_clean":"2024-03-23T23:58:16.570223+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:58:16.570223+0000","last_undegraded":"2024-03-23T23:58:16.570223+0000","last_fullsized":"2024-03-23T23:58:16.570223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:38.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578452+0000","last_change":"2024-03-23T23:56:29.890549+0000","last_active":"2024-03-23T23:58:16.578452+0000","last_peered":"2024-03-23T23:58:16.578452+0000","last_clean":"2024-03-23T23:58:16.578452+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:58:16.578452+0000","last_undegraded":"2024-03-23T23:58:16.578452+0000","last_fullsized":"2024-03-23T23:58:16.578452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595774+0000","last_change":"2024-03-23T23:56:30.885979+0000","last_active":"2024-03-23T23:58:16.595774+0000","last_peered":"2024-03-23T23:58:16.595774+0000","last_clean":"2024-03-23T23:58:16.595774+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:58:16.595774+0000","last_undegraded":"2024-03-23T23:58:16.595774+0000","last_fullsized":"2024-03-23T23:58:16.595774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568569+0000","last_change":"2024-03-23T23:56:29.892444+0000","last_active":"2024-03-23T23:58:16.568569+0000","last_peered":"2024-03-23T23:58:16.568569+0000","last_clean":"2024-03-23T23:58:16.568569+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:58:16.568569+0000","last_undegraded":"2024-03-23T23:58:16.568569+0000","last_fullsized":"2024-03-23T23:58:16.568569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577429+0000","last_change":"2024-03-23T23:56:29.887065+0000","last_active":"2024-03-23T23:58:16.577429+0000","last_peered":"2024-03-23T23:58:16.577429+0000","last_clean":"2024-03-23T23:58:16.577429+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:58:16.577429+0000","last_undegraded":"2024-03-23T23:58:16.577429+0000","last_fullsized":"2024-03-23T23:58:16.577429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:05:45.290286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577241+0000","last_change":"2024-03-23T23:56:30.881409+0000","last_active":"2024-03-23T23:58:16.577241+0000","last_peered":"2024-03-23T23:58:16.577241+0000","last_clean":"2024-03-23T23:58:16.577241+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:58:16.577241+0000","last_undegraded":"2024-03-23T23:58:16.577241+0000","last_fullsized":"2024-03-23T23:58:16.577241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593896+0000","last_change":"2024-03-23T23:56:29.897340+0000","last_active":"2024-03-23T23:58:16.593896+0000","last_peered":"2024-03-23T23:58:16.593896+0000","last_clean":"2024-03-23T23:58:16.593896+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:58:16.593896+0000","last_undegraded":"2024-03-23T23:58:16.593896+0000","last_fullsized":"2024-03-23T23:58:16.593896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593951+0000","last_change":"2024-03-23T23:56:30.876574+0000","last_active":"2024-03-23T23:58:16.593951+0000","last_peered":"2024-03-23T23:58:16.593951+0000","last_clean":"2024-03-23T23:58:16.593951+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:58:16.593951+0000","last_undegraded":"2024-03-23T23:58:16.593951+0000","last_fullsized":"2024-03-23T23:58:16.593951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569976+0000","last_change":"2024-03-23T23:56:29.894494+0000","last_active":"2024-03-23T23:58:16.569976+0000","last_peered":"2024-03-23T23:58:16.569976+0000","last_clean":"2024-03-23T23:58:16.569976+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:58:16.569976+0000","last_undegraded":"2024-03-23T23:58:16.569976+0000","last_fullsized":"2024-03-23T23:58:16.569976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595145+0000","last_change":"2024-03-23T23:56:30.891335+0000","last_active":"2024-03-23T23:58:16.595145+0000","last_peered":"2024-03-23T23:58:16.595145+0000","last_clean":"2024-03-23T23:58:16.595145+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:58:16.595145+0000","last_undegraded":"2024-03-23T23:58:16.595145+0000","last_fullsized":"2024-03-23T23:58:16.595145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595318+0000","last_change":"2024-03-23T23:56:29.886369+0000","last_active":"2024-03-23T23:58:16.595318+0000","last_peered":"2024-03-23T23:58:16.595318+0000","last_clean":"2024-03-23T23:58:16.595318+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:58:16.595318+0000","last_undegraded":"2024-03-23T23:58:16.595318+0000","last_fullsized":"2024-03-23T23:58:16.595318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596040+0000","last_change":"2024-03-23T23:56:30.876882+0000","last_active":"2024-03-23T23:58:16.596040+0000","last_peered":"2024-03-23T23:58:16.596040+0000","last_clean":"2024-03-23T23:58:16.596040+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:58:16.596040+0000","last_undegraded":"2024-03-23T23:58:16.596040+0000","last_fullsized":"2024-03-23T23:58:16.596040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'9","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595896+0000","last_change":"2024-03-23T23:56:29.886611+0000","last_active":"2024-03-23T23:58:16.595896+0000","last_peered":"2024-03-23T23:58:16.595896+0000","last_clean":"2024-03-23T23:58:16.595896+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:58:16.595896+0000","last_undegraded":"2024-03-23T23:58:16.595896+0000","last_fullsized":"2024-03-23T23:58:16.595896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571209+0000","last_change":"2024-03-23T23:56:30.871258+0000","last_active":"2024-03-23T23:58:16.571209+0000","last_peered":"2024-03-23T23:58:16.571209+0000","last_clean":"2024-03-23T23:58:16.571209+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:58:16.571209+0000","last_undegraded":"2024-03-23T23:58:16.571209+0000","last_fullsized":"2024-03-23T23:58:16.571209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:12.879233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'65","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569445+0000","last_change":"2024-03-23T23:56:29.886316+0000","last_active":"2024-03-23T23:58:16.569445+0000","last_peered":"2024-03-23T23:58:16.569445+0000","last_clean":"2024-03-23T23:58:16.569445+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:58:16.569445+0000","last_undegraded":"2024-03-23T23:58:16.569445+0000","last_fullsized":"2024-03-23T23:58:16.569445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596639+0000","last_change":"2024-03-23T23:56:30.885592+0000","last_active":"2024-03-23T23:58:16.596639+0000","last_peered":"2024-03-23T23:58:16.596639+0000","last_clean":"2024-03-23T23:58:16.596639+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:58:16.596639+0000","last_undegraded":"2024-03-23T23:58:16.596639+0000","last_fullsized":"2024-03-23T23:58:16.596639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595974+0000","last_change":"2024-03-23T23:56:29.891265+0000","last_active":"2024-03-23T23:58:16.595974+0000","last_peered":"2024-03-23T23:58:16.595974+0000","last_clean":"2024-03-23T23:58:16.595974+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:58:16.595974+0000","last_undegraded":"2024-03-23T23:58:16.595974+0000","last_fullsized":"2024-03-23T23:58:16.595974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:53.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594927+0000","last_change":"2024-03-23T23:56:30.886240+0000","last_active":"2024-03-23T23:58:16.594927+0000","last_peered":"2024-03-23T23:58:16.594927+0000","last_clean":"2024-03-23T23:58:16.594927+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:58:16.594927+0000","last_undegraded":"2024-03-23T23:58:16.594927+0000","last_fullsized":"2024-03-23T23:58:16.594927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594083+0000","last_change":"2024-03-23T23:56:29.890485+0000","last_active":"2024-03-23T23:58:16.594083+0000","last_peered":"2024-03-23T23:58:16.594083+0000","last_clean":"2024-03-23T23:58:16.594083+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:58:16.594083+0000","last_undegraded":"2024-03-23T23:58:16.594083+0000","last_fullsized":"2024-03-23T23:58:16.594083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595946+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:58:16.595946+0000","last_peered":"2024-03-23T23:58:16.595946+0000","last_clean":"2024-03-23T23:58:16.595946+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:58:16.595946+0000","last_undegraded":"2024-03-23T23:58:16.595946+0000","last_fullsized":"2024-03-23T23:58:16.595946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568289+0000","last_change":"2024-03-23T23:56:29.896833+0000","last_active":"2024-03-23T23:58:16.568289+0000","last_peered":"2024-03-23T23:58:16.568289+0000","last_clean":"2024-03-23T23:58:16.568289+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:58:16.568289+0000","last_undegraded":"2024-03-23T23:58:16.568289+0000","last_fullsized":"2024-03-23T23:58:16.568289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568088+0000","last_change":"2024-03-23T23:56:30.876178+0000","last_active":"2024-03-23T23:58:16.568088+0000","last_peered":"2024-03-23T23:58:16.568088+0000","last_clean":"2024-03-23T23:58:16.568088+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:58:16.568088+0000","last_undegraded":"2024-03-23T23:58:16.568088+0000","last_fullsized":"2024-03-23T23:58:16.568088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.565707+0000","last_change":"2024-03-23T23:56:29.879437+0000","last_active":"2024-03-23T23:58:16.565707+0000","last_peered":"2024-03-23T23:58:16.565707+0000","last_clean":"2024-03-23T23:58:16.565707+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:58:16.565707+0000","last_undegraded":"2024-03-23T23:58:16.565707+0000","last_fullsized":"2024-03-23T23:58:16.565707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595633+0000","last_change":"2024-03-23T23:56:30.888310+0000","last_active":"2024-03-23T23:58:16.595633+0000","last_peered":"2024-03-23T23:58:16.595633+0000","last_clean":"2024-03-23T23:58:16.595633+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:58:16.595633+0000","last_undegraded":"2024-03-23T23:58:16.595633+0000","last_fullsized":"2024-03-23T23:58:16.595633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.572015+0000","last_change":"2024-03-23T23:56:29.892548+0000","last_active":"2024-03-23T23:58:16.572015+0000","last_peered":"2024-03-23T23:58:16.572015+0000","last_clean":"2024-03-23T23:58:16.572015+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:58:16.572015+0000","last_undegraded":"2024-03-23T23:58:16.572015+0000","last_fullsized":"2024-03-23T23:58:16.572015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:53:30.285127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596206+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:58:16.596206+0000","last_peered":"2024-03-23T23:58:16.596206+0000","last_clean":"2024-03-23T23:58:16.596206+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:58:16.596206+0000","last_undegraded":"2024-03-23T23:58:16.596206+0000","last_fullsized":"2024-03-23T23:58:16.596206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566992+0000","last_change":"2024-03-23T23:56:29.883486+0000","last_active":"2024-03-23T23:58:16.566992+0000","last_peered":"2024-03-23T23:58:16.566992+0000","last_clean":"2024-03-23T23:58:16.566992+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:58:16.566992+0000","last_undegraded":"2024-03-23T23:58:16.566992+0000","last_fullsized":"2024-03-23T23:58:16.566992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596565+0000","last_change":"2024-03-23T23:56:30.887560+0000","last_active":"2024-03-23T23:58:16.596565+0000","last_peered":"2024-03-23T23:58:16.596565+0000","last_clean":"2024-03-23T23:58:16.596565+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:58:16.596565+0000","last_undegraded":"2024-03-23T23:58:16.596565+0000","last_fullsized":"2024-03-23T23:58:16.596565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596103+0000","last_change":"2024-03-23T23:56:29.897890+0000","last_active":"2024-03-23T23:58:16.596103+0000","last_peered":"2024-03-23T23:58:16.596103+0000","last_clean":"2024-03-23T23:58:16.596103+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:58:16.596103+0000","last_undegraded":"2024-03-23T23:58:16.596103+0000","last_fullsized":"2024-03-23T23:58:16.596103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594421+0000","last_change":"2024-03-23T23:56:30.888006+0000","last_active":"2024-03-23T23:58:16.594421+0000","last_peered":"2024-03-23T23:58:16.594421+0000","last_clean":"2024-03-23T23:58:16.594421+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:58:16.594421+0000","last_undegraded":"2024-03-23T23:58:16.594421+0000","last_fullsized":"2024-03-23T23:58:16.594421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566500+0000","last_change":"2024-03-23T23:56:29.888464+0000","last_active":"2024-03-23T23:58:16.566500+0000","last_peered":"2024-03-23T23:58:16.566500+0000","last_clean":"2024-03-23T23:58:16.566500+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:58:16.566500+0000","last_undegraded":"2024-03-23T23:58:16.566500+0000","last_fullsized":"2024-03-23T23:58:16.566500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596781+0000","last_change":"2024-03-23T23:56:30.883536+0000","last_active":"2024-03-23T23:58:16.596781+0000","last_peered":"2024-03-23T23:58:16.596781+0000","last_clean":"2024-03-23T23:58:16.596781+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:58:16.596781+0000","last_undegraded":"2024-03-23T23:58:16.596781+0000","last_fullsized":"2024-03-23T23:58:16.596781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:30:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594838+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:58:16.594838+0000","last_peered":"2024-03-23T23:58:16.594838+0000","last_clean":"2024-03-23T23:58:16.594838+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:58:16.594838+0000","last_undegraded":"2024-03-23T23:58:16.594838+0000","last_fullsized":"2024-03-23T23:58:16.594838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593648+0000","last_change":"2024-03-23T23:56:29.886033+0000","last_active":"2024-03-23T23:58:16.593648+0000","last_peered":"2024-03-23T23:58:16.593648+0000","last_clean":"2024-03-23T23:58:16.593648+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:58:16.593648+0000","last_undegraded":"2024-03-23T23:58:16.593648+0000","last_fullsized":"2024-03-23T23:58:16.593648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577750+0000","last_change":"2024-03-23T23:56:30.883752+0000","last_active":"2024-03-23T23:58:16.577750+0000","last_peered":"2024-03-23T23:58:16.577750+0000","last_clean":"2024-03-23T23:58:16.577750+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:58:16.577750+0000","last_undegraded":"2024-03-23T23:58:16.577750+0000","last_fullsized":"2024-03-23T23:58:16.577750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594644+0000","last_change":"2024-03-23T23:56:29.881565+0000","last_active":"2024-03-23T23:58:16.594644+0000","last_peered":"2024-03-23T23:58:16.594644+0000","last_clean":"2024-03-23T23:58:16.594644+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:58:16.594644+0000","last_undegraded":"2024-03-23T23:58:16.594644+0000","last_fullsized":"2024-03-23T23:58:16.594644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595095+0000","last_change":"2024-03-23T23:56:30.886503+0000","last_active":"2024-03-23T23:58:16.595095+0000","last_peered":"2024-03-23T23:58:16.595095+0000","last_clean":"2024-03-23T23:58:16.595095+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:58:16.595095+0000","last_undegraded":"2024-03-23T23:58:16.595095+0000","last_fullsized":"2024-03-23T23:58:16.595095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:02:03.136599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'8","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:17.065078+0000","last_change":"2024-03-23T23:56:29.886668+0000","last_active":"2024-03-23T23:58:17.065078+0000","last_peered":"2024-03-23T23:58:17.065078+0000","last_clean":"2024-03-23T23:58:17.065078+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:58:17.065078+0000","last_undegraded":"2024-03-23T23:58:17.065078+0000","last_fullsized":"2024-03-23T23:58:17.065078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594097+0000","last_change":"2024-03-23T23:56:30.873826+0000","last_active":"2024-03-23T23:58:16.594097+0000","last_peered":"2024-03-23T23:58:16.594097+0000","last_clean":"2024-03-23T23:58:16.594097+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:58:16.594097+0000","last_undegraded":"2024-03-23T23:58:16.594097+0000","last_fullsized":"2024-03-23T23:58:16.594097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594310+0000","last_change":"2024-03-23T23:56:29.889635+0000","last_active":"2024-03-23T23:58:16.594310+0000","last_peered":"2024-03-23T23:58:16.594310+0000","last_clean":"2024-03-23T23:58:16.594310+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:58:16.594310+0000","last_undegraded":"2024-03-23T23:58:16.594310+0000","last_fullsized":"2024-03-23T23:58:16.594310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571197+0000","last_change":"2024-03-23T23:56:30.883369+0000","last_active":"2024-03-23T23:58:16.571197+0000","last_peered":"2024-03-23T23:58:16.571197+0000","last_clean":"2024-03-23T23:58:16.571197+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:58:16.571197+0000","last_undegraded":"2024-03-23T23:58:16.571197+0000","last_fullsized":"2024-03-23T23:58:16.571197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:12.049887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594935+0000","last_change":"2024-03-23T23:56:29.883626+0000","last_active":"2024-03-23T23:58:16.594935+0000","last_peered":"2024-03-23T23:58:16.594935+0000","last_clean":"2024-03-23T23:58:16.594935+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:58:16.594935+0000","last_undegraded":"2024-03-23T23:58:16.594935+0000","last_fullsized":"2024-03-23T23:58:16.594935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594655+0000","last_change":"2024-03-23T23:56:30.888942+0000","last_active":"2024-03-23T23:58:16.594655+0000","last_peered":"2024-03-23T23:58:16.594655+0000","last_clean":"2024-03-23T23:58:16.594655+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:58:16.594655+0000","last_undegraded":"2024-03-23T23:58:16.594655+0000","last_fullsized":"2024-03-23T23:58:16.594655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.597034+0000","last_change":"2024-03-23T23:56:29.886058+0000","last_active":"2024-03-23T23:58:16.597034+0000","last_peered":"2024-03-23T23:58:16.597034+0000","last_clean":"2024-03-23T23:58:16.597034+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:58:16.597034+0000","last_undegraded":"2024-03-23T23:58:16.597034+0000","last_fullsized":"2024-03-23T23:58:16.597034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:16.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594642+0000","last_change":"2024-03-23T23:56:30.878188+0000","last_active":"2024-03-23T23:58:16.594642+0000","last_peered":"2024-03-23T23:58:16.594642+0000","last_clean":"2024-03-23T23:58:16.594642+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:58:16.594642+0000","last_undegraded":"2024-03-23T23:58:16.594642+0000","last_fullsized":"2024-03-23T23:58:16.594642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595255+0000","last_change":"2024-03-23T23:56:29.884993+0000","last_active":"2024-03-23T23:58:16.595255+0000","last_peered":"2024-03-23T23:58:16.595255+0000","last_clean":"2024-03-23T23:58:16.595255+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:58:16.595255+0000","last_undegraded":"2024-03-23T23:58:16.595255+0000","last_fullsized":"2024-03-23T23:58:16.595255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566369+0000","last_change":"2024-03-23T23:57:11.228752+0000","last_active":"2024-03-23T23:58:16.566369+0000","last_peered":"2024-03-23T23:58:16.566369+0000","last_clean":"2024-03-23T23:58:16.566369+0000","last_became_active":"2024-03-23T23:57:11.227669+0000","last_became_peered":"2024-03-23T23:57:11.227669+0000","last_unstale":"2024-03-23T23:58:16.566369+0000","last_undegraded":"2024-03-23T23:58:16.566369+0000","last_fullsized":"2024-03-23T23:58:16.566369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.570023+0000","last_change":"2024-03-23T23:56:29.881331+0000","last_active":"2024-03-23T23:58:16.570023+0000","last_peered":"2024-03-23T23:58:16.570023+0000","last_clean":"2024-03-23T23:58:16.570023+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:58:16.570023+0000","last_undegraded":"2024-03-23T23:58:16.570023+0000","last_fullsized":"2024-03-23T23:58:16.570023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595989+0000","last_change":"2024-03-23T23:56:30.874453+0000","last_active":"2024-03-23T23:58:16.595989+0000","last_peered":"2024-03-23T23:58:16.595989+0000","last_clean":"2024-03-23T23:58:16.595989+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:58:16.595989+0000","last_undegraded":"2024-03-23T23:58:16.595989+0000","last_fullsized":"2024-03-23T23:58:16.595989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594425+0000","last_change":"2024-03-23T23:56:29.879862+0000","last_active":"2024-03-23T23:58:16.594425+0000","last_peered":"2024-03-23T23:58:16.594425+0000","last_clean":"2024-03-23T23:58:16.594425+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:58:16.594425+0000","last_undegraded":"2024-03-23T23:58:16.594425+0000","last_fullsized":"2024-03-23T23:58:16.594425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569771+0000","last_change":"2024-03-23T23:56:30.874693+0000","last_active":"2024-03-23T23:58:16.569771+0000","last_peered":"2024-03-23T23:58:16.569771+0000","last_clean":"2024-03-23T23:58:16.569771+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:58:16.569771+0000","last_undegraded":"2024-03-23T23:58:16.569771+0000","last_fullsized":"2024-03-23T23:58:16.569771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594558+0000","last_change":"2024-03-23T23:56:29.887900+0000","last_active":"2024-03-23T23:58:16.594558+0000","last_peered":"2024-03-23T23:58:16.594558+0000","last_clean":"2024-03-23T23:58:16.594558+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:58:16.594558+0000","last_undegraded":"2024-03-23T23:58:16.594558+0000","last_fullsized":"2024-03-23T23:58:16.594558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577351+0000","last_change":"2024-03-23T23:56:30.875932+0000","last_active":"2024-03-23T23:58:16.577351+0000","last_peered":"2024-03-23T23:58:16.577351+0000","last_clean":"2024-03-23T23:58:16.577351+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:58:16.577351+0000","last_undegraded":"2024-03-23T23:58:16.577351+0000","last_fullsized":"2024-03-23T23:58:16.577351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594461+0000","last_change":"2024-03-23T23:56:29.884727+0000","last_active":"2024-03-23T23:58:16.594461+0000","last_peered":"2024-03-23T23:58:16.594461+0000","last_clean":"2024-03-23T23:58:16.594461+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:58:16.594461+0000","last_undegraded":"2024-03-23T23:58:16.594461+0000","last_fullsized":"2024-03-23T23:58:16.594461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578130+0000","last_change":"2024-03-23T23:56:30.887213+0000","last_active":"2024-03-23T23:58:16.578130+0000","last_peered":"2024-03-23T23:58:16.578130+0000","last_clean":"2024-03-23T23:58:16.578130+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:58:16.578130+0000","last_undegraded":"2024-03-23T23:58:16.578130+0000","last_fullsized":"2024-03-23T23:58:16.578130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596027+0000","last_change":"2024-03-23T23:56:29.895498+0000","last_active":"2024-03-23T23:58:16.596027+0000","last_peered":"2024-03-23T23:58:16.596027+0000","last_clean":"2024-03-23T23:58:16.596027+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:58:16.596027+0000","last_undegraded":"2024-03-23T23:58:16.596027+0000","last_fullsized":"2024-03-23T23:58:16.596027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568366+0000","last_change":"2024-03-23T23:56:30.884001+0000","last_active":"2024-03-23T23:58:16.568366+0000","last_peered":"2024-03-23T23:58:16.568366+0000","last_clean":"2024-03-23T23:58:16.568366+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:58:16.568366+0000","last_undegraded":"2024-03-23T23:58:16.568366+0000","last_fullsized":"2024-03-23T23:58:16.568366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594334+0000","last_change":"2024-03-23T23:56:30.889155+0000","last_active":"2024-03-23T23:58:16.594334+0000","last_peered":"2024-03-23T23:58:16.594334+0000","last_clean":"2024-03-23T23:58:16.594334+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:58:16.594334+0000","last_undegraded":"2024-03-23T23:58:16.594334+0000","last_fullsized":"2024-03-23T23:58:16.594334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596405+0000","last_change":"2024-03-23T23:56:29.888617+0000","last_active":"2024-03-23T23:58:16.596405+0000","last_peered":"2024-03-23T23:58:16.596405+0000","last_clean":"2024-03-23T23:58:16.596405+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:58:16.596405+0000","last_undegraded":"2024-03-23T23:58:16.596405+0000","last_fullsized":"2024-03-23T23:58:16.596405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594138+0000","last_change":"2024-03-23T23:56:30.888308+0000","last_active":"2024-03-23T23:58:16.594138+0000","last_peered":"2024-03-23T23:58:16.594138+0000","last_clean":"2024-03-23T23:58:16.594138+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:58:16.594138+0000","last_undegraded":"2024-03-23T23:58:16.594138+0000","last_fullsized":"2024-03-23T23:58:16.594138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596826+0000","last_change":"2024-03-23T23:56:29.879942+0000","last_active":"2024-03-23T23:58:16.596826+0000","last_peered":"2024-03-23T23:58:16.596826+0000","last_clean":"2024-03-23T23:58:16.596826+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:58:16.596826+0000","last_undegraded":"2024-03-23T23:58:16.596826+0000","last_fullsized":"2024-03-23T23:58:16.596826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595895+0000","last_change":"2024-03-23T23:57:11.438439+0000","last_active":"2024-03-23T23:58:16.595895+0000","last_peered":"2024-03-23T23:58:16.595895+0000","last_clean":"2024-03-23T23:58:16.595895+0000","last_became_active":"2024-03-23T23:57:11.437365+0000","last_became_peered":"2024-03-23T23:57:11.437365+0000","last_unstale":"2024-03-23T23:58:16.595895+0000","last_undegraded":"2024-03-23T23:58:16.595895+0000","last_fullsized":"2024-03-23T23:58:16.595895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:30:27.781133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578142+0000","last_change":"2024-03-23T23:56:29.889380+0000","last_active":"2024-03-23T23:58:16.578142+0000","last_peered":"2024-03-23T23:58:16.578142+0000","last_clean":"2024-03-23T23:58:16.578142+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:58:16.578142+0000","last_undegraded":"2024-03-23T23:58:16.578142+0000","last_fullsized":"2024-03-23T23:58:16.578142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566771+0000","last_change":"2024-03-23T23:57:11.078716+0000","last_active":"2024-03-23T23:58:16.566771+0000","last_peered":"2024-03-23T23:58:16.566771+0000","last_clean":"2024-03-23T23:58:16.566771+0000","last_became_active":"2024-03-23T23:57:11.077960+0000","last_became_peered":"2024-03-23T23:57:11.077960+0000","last_unstale":"2024-03-23T23:58:16.566771+0000","last_undegraded":"2024-03-23T23:58:16.566771+0000","last_fullsized":"2024-03-23T23:58:16.566771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596412+0000","last_change":"2024-03-23T23:56:29.886266+0000","last_active":"2024-03-23T23:58:16.596412+0000","last_peered":"2024-03-23T23:58:16.596412+0000","last_clean":"2024-03-23T23:58:16.596412+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:58:16.596412+0000","last_undegraded":"2024-03-23T23:58:16.596412+0000","last_fullsized":"2024-03-23T23:58:16.596412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68282,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":120,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":136564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":684848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":160675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":93988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":94024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":161382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":684904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:23.405 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.664+0000 7f63e5000640 1 Processor -- start 2024-03-23T23:58:23.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.664+0000 7f63e5000640 1 -- start start 2024-03-23T23:58:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.665+0000 7f63e5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63e00b7930 0x7f63e0147760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.665+0000 7f63e5000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00af450 0x7f63e0147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.665+0000 7f63e5000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00b7d10 con 0x7f63e00b32c0 2024-03-23T23:58:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.665+0000 7f63e5000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00af8c0 con 0x7f63e00b7930 2024-03-23T23:58:23.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.665+0000 7f63e5000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00b3900 con 0x7f63e00af450 2024-03-23T23:58:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.666+0000 7f63df400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63e00b7930 0x7f63e0147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.666+0000 7f63df400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63e00b7930 0x7f63e0147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:56366/0 (socket says 172.21.15.31:56366) 2024-03-23T23:58:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.666+0000 7f63df400640 1 -- 172.21.15.31:0/3708871265 learned_addr learned my addr 172.21.15.31:0/3708871265 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:23.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.666+0000 7f63dfe00640 1 --2- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00af450 0x7f63e0147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.667+0000 7f63df400640 1 -- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00af450 msgr2=0x7f63e0147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:23.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.667+0000 7f63df400640 1 --2- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00af450 0x7f63e0147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.667+0000 7f63df400640 1 -- 172.21.15.31:0/3708871265 >> v1:172.21.15.59:6789/0 conn(0x7f63e00b32c0 legacy=0x7f63e00aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.667+0000 7f63df400640 1 -- 172.21.15.31:0/3708871265 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00b4d50 con 0x7f63e00b7930 2024-03-23T23:58:23.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.668+0000 7f63df400640 1 --2- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00b7930 0x7f63e0147760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009870 tx=0x7f63d002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6c0ac4aebdffdec server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:23.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.668+0000 7f63de000640 1 -- 172.21.15.31:0/3708871265 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00317c0 con 0x7f63e00b7930 2024-03-23T23:58:23.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63de000640 1 -- 172.21.15.31:0/3708871265 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0037070 con 0x7f63e00b7930 2024-03-23T23:58:23.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63de000640 1 -- 172.21.15.31:0/3708871265 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0031b80 con 0x7f63e00b7930 2024-03-23T23:58:23.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 -- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00b7930 msgr2=0x7f63e0147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 --2- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00b7930 0x7f63e0147760 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009870 tx=0x7f63d002b860 comp rx=0 tx=0).stop 2024-03-23T23:58:23.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 -- 172.21.15.31:0/3708871265 shutdown_connections 2024-03-23T23:58:23.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 --2- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00af450 0x7f63e0147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 --2- 172.21.15.31:0/3708871265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00b7930 0x7f63e0147760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 -- 172.21.15.31:0/3708871265 >> 172.21.15.31:0/3708871265 conn(0x7f63e006cf40 msgr2=0x7f63e006ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:23.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 -- 172.21.15.31:0/3708871265 shutdown_connections 2024-03-23T23:58:23.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.669+0000 7f63e5000640 1 -- 172.21.15.31:0/3708871265 wait complete. 2024-03-23T23:58:23.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.671+0000 7f63e5000640 1 Processor -- start 2024-03-23T23:58:23.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.671+0000 7f63e5000640 1 -- start start 2024-03-23T23:58:23.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63e5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00af450 0x7f63e00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63e5000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00b32c0 0x7f63e01413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63e5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e00b7930 0x7f63e0141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63e5000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00b49d0 con 0x7f63e00b7930 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63e5000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00b3e30 con 0x7f63e00af450 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63e5000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00b51f0 con 0x7f63e00b32c0 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e00b7930 0x7f63e0141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e00b7930 0x7f63e0141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33668/0 (socket says 172.21.15.31:33668) 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 -- 172.21.15.31:0/2320442642 learned_addr learned my addr 172.21.15.31:0/2320442642 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63df400640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00af450 0x7f63e00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dea00640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00b32c0 0x7f63e01413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 -- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00b32c0 msgr2=0x7f63e01413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00b32c0 0x7f63e01413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 -- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00af450 msgr2=0x7f63e00b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00af450 0x7f63e00b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.672+0000 7f63dfe00640 1 -- 172.21.15.31:0/2320442642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0143170 con 0x7f63e00b7930 2024-03-23T23:58:23.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.673+0000 7f63dfe00640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e00b7930 0x7f63e0141e20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009dd0 tx=0x7f63d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:23.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.673+0000 7f63d7400640 1 -- 172.21.15.31:0/2320442642 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8018020 con 0x7f63e00b7930 2024-03-23T23:58:23.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.673+0000 7f63d7400640 1 -- 172.21.15.31:0/2320442642 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8014480 con 0x7f63e00b7930 2024-03-23T23:58:23.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.673+0000 7f63d7400640 1 -- 172.21.15.31:0/2320442642 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8014870 con 0x7f63e00b7930 2024-03-23T23:58:23.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.673+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e01402d0 con 0x7f63e00b7930 2024-03-23T23:58:23.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.673+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e00b2510 con 0x7f63e00b7930 2024-03-23T23:58:23.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.674+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e00752c0 con 0x7f63e00b7930 2024-03-23T23:58:23.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.675+0000 7f63d7400640 1 -- 172.21.15.31:0/2320442642 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f63d8005d10 con 0x7f63e00b7930 2024-03-23T23:58:23.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.676+0000 7f63d7400640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f63c006bbd0 0x7f63c006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:23.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.676+0000 7f63d7400640 1 -- 172.21.15.31:0/2320442642 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f63d808b6a0 con 0x7f63e00b7930 2024-03-23T23:58:23.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.677+0000 7f63df400640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f63c006bbd0 0x7f63c006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:23.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.678+0000 7f63df400640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f63c006bbd0 0x7f63c006e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f63d0036000 tx=0x7f63d003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:23.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.681+0000 7f63d7400640 1 -- 172.21.15.31:0/2320442642 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f63d8022070 con 0x7f63e00b7930 2024-03-23T23:58:23.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.878+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63e006b390 con 0x7f63c006bbd0 2024-03-23T23:58:23.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.897+0000 7f63d7400640 1 -- 172.21.15.31:0/2320442642 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251981 (secure 0 0 0) 0x7f63e006b390 con 0x7f63c006bbd0 2024-03-23T23:58:23.901 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:58:23.902 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:58:23.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f63c006bbd0 msgr2=0x7f63c006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f63c006bbd0 0x7f63c006e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f63d0036000 tx=0x7f63d003d040 comp rx=0 tx=0).stop 2024-03-23T23:58:23.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e00b7930 msgr2=0x7f63e0141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e00b7930 0x7f63e0141e20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009dd0 tx=0x7f63d800c490 comp rx=0 tx=0).stop 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 shutdown_connections 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f63c006bbd0 0x7f63c006e090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63e00b7930 0x7f63e0141e20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63e00b32c0 0x7f63e01413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 --2- 172.21.15.31:0/2320442642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63e00af450 0x7f63e00b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 >> 172.21.15.31:0/2320442642 conn(0x7f63e006cf40 msgr2=0x7f63e0098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:23.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 shutdown_connections 2024-03-23T23:58:23.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:23.904+0000 7f63e5000640 1 -- 172.21.15.31:0/2320442642 wait complete. 2024-03-23T23:58:23.923 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-03-23T23:58:23.370129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658650,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":123,"num_read_kb":107,"num_write":287,"num_write_kb":2546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3344,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3424256,"data_stored":2068484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":83,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.012889"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595965+0000","last_change":"2024-03-23T23:56:30.885878+0000","last_active":"2024-03-23T23:58:16.595965+0000","last_peered":"2024-03-23T23:58:16.595965+0000","last_clean":"2024-03-23T23:58:16.595965+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:58:16.595965+0000","last_undegraded":"2024-03-23T23:58:16.595965+0000","last_fullsized":"2024-03-23T23:58:16.595965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594966+0000","last_change":"2024-03-23T23:56:30.875303+0000","last_active":"2024-03-23T23:58:16.594966+0000","last_peered":"2024-03-23T23:58:16.594966+0000","last_clean":"2024-03-23T23:58:16.594966+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:58:16.594966+0000","last_undegraded":"2024-03-23T23:58:16.594966+0000","last_fullsized":"2024-03-23T23:58:16.594966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595393+0000","last_change":"2024-03-23T23:56:30.883893+0000","last_active":"2024-03-23T23:58:16.595393+0000","last_peered":"2024-03-23T23:58:16.595393+0000","last_clean":"2024-03-23T23:58:16.595393+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:58:16.595393+0000","last_undegraded":"2024-03-23T23:58:16.595393+0000","last_fullsized":"2024-03-23T23:58:16.595393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593882+0000","last_change":"2024-03-23T23:56:30.891008+0000","last_active":"2024-03-23T23:58:16.593882+0000","last_peered":"2024-03-23T23:58:16.593882+0000","last_clean":"2024-03-23T23:58:16.593882+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:58:16.593882+0000","last_undegraded":"2024-03-23T23:58:16.593882+0000","last_fullsized":"2024-03-23T23:58:16.593882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595756+0000","last_change":"2024-03-23T23:56:30.877242+0000","last_active":"2024-03-23T23:58:16.595756+0000","last_peered":"2024-03-23T23:58:16.595756+0000","last_clean":"2024-03-23T23:58:16.595756+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:58:16.595756+0000","last_undegraded":"2024-03-23T23:58:16.595756+0000","last_fullsized":"2024-03-23T23:58:16.595756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593683+0000","last_change":"2024-03-23T23:56:30.890268+0000","last_active":"2024-03-23T23:58:16.593683+0000","last_peered":"2024-03-23T23:58:16.593683+0000","last_clean":"2024-03-23T23:58:16.593683+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:58:16.593683+0000","last_undegraded":"2024-03-23T23:58:16.593683+0000","last_fullsized":"2024-03-23T23:58:16.593683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595327+0000","last_change":"2024-03-23T23:56:30.885059+0000","last_active":"2024-03-23T23:58:16.595327+0000","last_peered":"2024-03-23T23:58:16.595327+0000","last_clean":"2024-03-23T23:58:16.595327+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:58:16.595327+0000","last_undegraded":"2024-03-23T23:58:16.595327+0000","last_fullsized":"2024-03-23T23:58:16.595327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577052+0000","last_change":"2024-03-23T23:56:30.881077+0000","last_active":"2024-03-23T23:58:16.577052+0000","last_peered":"2024-03-23T23:58:16.577052+0000","last_clean":"2024-03-23T23:58:16.577052+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:58:16.577052+0000","last_undegraded":"2024-03-23T23:58:16.577052+0000","last_fullsized":"2024-03-23T23:58:16.577052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596322+0000","last_change":"2024-03-23T23:56:30.883587+0000","last_active":"2024-03-23T23:58:16.596322+0000","last_peered":"2024-03-23T23:58:16.596322+0000","last_clean":"2024-03-23T23:58:16.596322+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:58:16.596322+0000","last_undegraded":"2024-03-23T23:58:16.596322+0000","last_fullsized":"2024-03-23T23:58:16.596322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569767+0000","last_change":"2024-03-23T23:56:30.888454+0000","last_active":"2024-03-23T23:58:16.569767+0000","last_peered":"2024-03-23T23:58:16.569767+0000","last_clean":"2024-03-23T23:58:16.569767+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:58:16.569767+0000","last_undegraded":"2024-03-23T23:58:16.569767+0000","last_fullsized":"2024-03-23T23:58:16.569767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569177+0000","last_change":"2024-03-23T23:56:30.881125+0000","last_active":"2024-03-23T23:58:16.569177+0000","last_peered":"2024-03-23T23:58:16.569177+0000","last_clean":"2024-03-23T23:58:16.569177+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:58:16.569177+0000","last_undegraded":"2024-03-23T23:58:16.569177+0000","last_fullsized":"2024-03-23T23:58:16.569177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571428+0000","last_change":"2024-03-23T23:56:30.863287+0000","last_active":"2024-03-23T23:58:16.571428+0000","last_peered":"2024-03-23T23:58:16.571428+0000","last_clean":"2024-03-23T23:58:16.571428+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:58:16.571428+0000","last_undegraded":"2024-03-23T23:58:16.571428+0000","last_fullsized":"2024-03-23T23:58:16.571428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:00.178139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577989+0000","last_change":"2024-03-23T23:56:30.881169+0000","last_active":"2024-03-23T23:58:16.577989+0000","last_peered":"2024-03-23T23:58:16.577989+0000","last_clean":"2024-03-23T23:58:16.577989+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:58:16.577989+0000","last_undegraded":"2024-03-23T23:58:16.577989+0000","last_fullsized":"2024-03-23T23:58:16.577989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'2","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594573+0000","last_change":"2024-03-23T23:56:30.876653+0000","last_active":"2024-03-23T23:58:16.594573+0000","last_peered":"2024-03-23T23:58:16.594573+0000","last_clean":"2024-03-23T23:58:16.594573+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:58:16.594573+0000","last_undegraded":"2024-03-23T23:58:16.594573+0000","last_fullsized":"2024-03-23T23:58:16.594573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:58:31.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594270+0000","last_change":"2024-03-23T23:56:30.862687+0000","last_active":"2024-03-23T23:58:16.594270+0000","last_peered":"2024-03-23T23:58:16.594270+0000","last_clean":"2024-03-23T23:58:16.594270+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:58:16.594270+0000","last_undegraded":"2024-03-23T23:58:16.594270+0000","last_fullsized":"2024-03-23T23:58:16.594270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593485+0000","last_change":"2024-03-23T23:56:30.882976+0000","last_active":"2024-03-23T23:58:16.593485+0000","last_peered":"2024-03-23T23:58:16.593485+0000","last_clean":"2024-03-23T23:58:16.593485+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:58:16.593485+0000","last_undegraded":"2024-03-23T23:58:16.593485+0000","last_fullsized":"2024-03-23T23:58:16.593485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595393+0000","last_change":"2024-03-23T23:56:30.895060+0000","last_active":"2024-03-23T23:58:16.595393+0000","last_peered":"2024-03-23T23:58:16.595393+0000","last_clean":"2024-03-23T23:58:16.595393+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:58:16.595393+0000","last_undegraded":"2024-03-23T23:58:16.595393+0000","last_fullsized":"2024-03-23T23:58:16.595393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566792+0000","last_change":"2024-03-23T23:56:30.892332+0000","last_active":"2024-03-23T23:58:16.566792+0000","last_peered":"2024-03-23T23:58:16.566792+0000","last_clean":"2024-03-23T23:58:16.566792+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:58:16.566792+0000","last_undegraded":"2024-03-23T23:58:16.566792+0000","last_fullsized":"2024-03-23T23:58:16.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596924+0000","last_change":"2024-03-23T23:56:30.881290+0000","last_active":"2024-03-23T23:58:16.596924+0000","last_peered":"2024-03-23T23:58:16.596924+0000","last_clean":"2024-03-23T23:58:16.596924+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:58:16.596924+0000","last_undegraded":"2024-03-23T23:58:16.596924+0000","last_fullsized":"2024-03-23T23:58:16.596924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:54:18.265054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568869+0000","last_change":"2024-03-23T23:56:30.875425+0000","last_active":"2024-03-23T23:58:16.568869+0000","last_peered":"2024-03-23T23:58:16.568869+0000","last_clean":"2024-03-23T23:58:16.568869+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:58:16.568869+0000","last_undegraded":"2024-03-23T23:58:16.568869+0000","last_fullsized":"2024-03-23T23:58:16.568869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595497+0000","last_change":"2024-03-23T23:56:30.884434+0000","last_active":"2024-03-23T23:58:16.595497+0000","last_peered":"2024-03-23T23:58:16.595497+0000","last_clean":"2024-03-23T23:58:16.595497+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:58:16.595497+0000","last_undegraded":"2024-03-23T23:58:16.595497+0000","last_fullsized":"2024-03-23T23:58:16.595497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566046+0000","last_change":"2024-03-23T23:57:11.230601+0000","last_active":"2024-03-23T23:58:16.566046+0000","last_peered":"2024-03-23T23:58:16.566046+0000","last_clean":"2024-03-23T23:58:16.566046+0000","last_became_active":"2024-03-23T23:57:11.229498+0000","last_became_peered":"2024-03-23T23:57:11.229498+0000","last_unstale":"2024-03-23T23:58:16.566046+0000","last_undegraded":"2024-03-23T23:58:16.566046+0000","last_fullsized":"2024-03-23T23:58:16.566046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577112+0000","last_change":"2024-03-23T23:56:30.888046+0000","last_active":"2024-03-23T23:58:16.577112+0000","last_peered":"2024-03-23T23:58:16.577112+0000","last_clean":"2024-03-23T23:58:16.577112+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:58:16.577112+0000","last_undegraded":"2024-03-23T23:58:16.577112+0000","last_fullsized":"2024-03-23T23:58:16.577112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593652+0000","last_change":"2024-03-23T23:56:30.886470+0000","last_active":"2024-03-23T23:58:16.593652+0000","last_peered":"2024-03-23T23:58:16.593652+0000","last_clean":"2024-03-23T23:58:16.593652+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:58:16.593652+0000","last_undegraded":"2024-03-23T23:58:16.593652+0000","last_fullsized":"2024-03-23T23:58:16.593652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578500+0000","last_change":"2024-03-23T23:56:30.885446+0000","last_active":"2024-03-23T23:58:16.578500+0000","last_peered":"2024-03-23T23:58:16.578500+0000","last_clean":"2024-03-23T23:58:16.578500+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:58:16.578500+0000","last_undegraded":"2024-03-23T23:58:16.578500+0000","last_fullsized":"2024-03-23T23:58:16.578500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569912+0000","last_change":"2024-03-23T23:56:30.882609+0000","last_active":"2024-03-23T23:58:16.569912+0000","last_peered":"2024-03-23T23:58:16.569912+0000","last_clean":"2024-03-23T23:58:16.569912+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:58:16.569912+0000","last_undegraded":"2024-03-23T23:58:16.569912+0000","last_fullsized":"2024-03-23T23:58:16.569912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'2","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595435+0000","last_change":"2024-03-23T23:56:30.881031+0000","last_active":"2024-03-23T23:58:16.595435+0000","last_peered":"2024-03-23T23:58:16.595435+0000","last_clean":"2024-03-23T23:58:16.595435+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:58:16.595435+0000","last_undegraded":"2024-03-23T23:58:16.595435+0000","last_fullsized":"2024-03-23T23:58:16.595435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577895+0000","last_change":"2024-03-23T23:56:30.887942+0000","last_active":"2024-03-23T23:58:16.577895+0000","last_peered":"2024-03-23T23:58:16.577895+0000","last_clean":"2024-03-23T23:58:16.577895+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:58:16.577895+0000","last_undegraded":"2024-03-23T23:58:16.577895+0000","last_fullsized":"2024-03-23T23:58:16.577895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595661+0000","last_change":"2024-03-23T23:56:30.882527+0000","last_active":"2024-03-23T23:58:16.595661+0000","last_peered":"2024-03-23T23:58:16.595661+0000","last_clean":"2024-03-23T23:58:16.595661+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:58:16.595661+0000","last_undegraded":"2024-03-23T23:58:16.595661+0000","last_fullsized":"2024-03-23T23:58:16.595661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593754+0000","last_change":"2024-03-23T23:56:30.885451+0000","last_active":"2024-03-23T23:58:16.593754+0000","last_peered":"2024-03-23T23:58:16.593754+0000","last_clean":"2024-03-23T23:58:16.593754+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:58:16.593754+0000","last_undegraded":"2024-03-23T23:58:16.593754+0000","last_fullsized":"2024-03-23T23:58:16.593754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.565795+0000","last_change":"2024-03-23T23:56:30.880152+0000","last_active":"2024-03-23T23:58:16.565795+0000","last_peered":"2024-03-23T23:58:16.565795+0000","last_clean":"2024-03-23T23:58:16.565795+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:58:16.565795+0000","last_undegraded":"2024-03-23T23:58:16.565795+0000","last_fullsized":"2024-03-23T23:58:16.565795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:17.288541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.567816+0000","last_change":"2024-03-23T23:56:30.880378+0000","last_active":"2024-03-23T23:58:16.567816+0000","last_peered":"2024-03-23T23:58:16.567816+0000","last_clean":"2024-03-23T23:58:16.567816+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:58:16.567816+0000","last_undegraded":"2024-03-23T23:58:16.567816+0000","last_fullsized":"2024-03-23T23:58:16.567816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.570223+0000","last_change":"2024-03-23T23:56:30.869148+0000","last_active":"2024-03-23T23:58:16.570223+0000","last_peered":"2024-03-23T23:58:16.570223+0000","last_clean":"2024-03-23T23:58:16.570223+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:58:16.570223+0000","last_undegraded":"2024-03-23T23:58:16.570223+0000","last_fullsized":"2024-03-23T23:58:16.570223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:38.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578452+0000","last_change":"2024-03-23T23:56:29.890549+0000","last_active":"2024-03-23T23:58:16.578452+0000","last_peered":"2024-03-23T23:58:16.578452+0000","last_clean":"2024-03-23T23:58:16.578452+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:58:16.578452+0000","last_undegraded":"2024-03-23T23:58:16.578452+0000","last_fullsized":"2024-03-23T23:58:16.578452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595774+0000","last_change":"2024-03-23T23:56:30.885979+0000","last_active":"2024-03-23T23:58:16.595774+0000","last_peered":"2024-03-23T23:58:16.595774+0000","last_clean":"2024-03-23T23:58:16.595774+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:58:16.595774+0000","last_undegraded":"2024-03-23T23:58:16.595774+0000","last_fullsized":"2024-03-23T23:58:16.595774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568569+0000","last_change":"2024-03-23T23:56:29.892444+0000","last_active":"2024-03-23T23:58:16.568569+0000","last_peered":"2024-03-23T23:58:16.568569+0000","last_clean":"2024-03-23T23:58:16.568569+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:58:16.568569+0000","last_undegraded":"2024-03-23T23:58:16.568569+0000","last_fullsized":"2024-03-23T23:58:16.568569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577429+0000","last_change":"2024-03-23T23:56:29.887065+0000","last_active":"2024-03-23T23:58:16.577429+0000","last_peered":"2024-03-23T23:58:16.577429+0000","last_clean":"2024-03-23T23:58:16.577429+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:58:16.577429+0000","last_undegraded":"2024-03-23T23:58:16.577429+0000","last_fullsized":"2024-03-23T23:58:16.577429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:05:45.290286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577241+0000","last_change":"2024-03-23T23:56:30.881409+0000","last_active":"2024-03-23T23:58:16.577241+0000","last_peered":"2024-03-23T23:58:16.577241+0000","last_clean":"2024-03-23T23:58:16.577241+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:58:16.577241+0000","last_undegraded":"2024-03-23T23:58:16.577241+0000","last_fullsized":"2024-03-23T23:58:16.577241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593896+0000","last_change":"2024-03-23T23:56:29.897340+0000","last_active":"2024-03-23T23:58:16.593896+0000","last_peered":"2024-03-23T23:58:16.593896+0000","last_clean":"2024-03-23T23:58:16.593896+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:58:16.593896+0000","last_undegraded":"2024-03-23T23:58:16.593896+0000","last_fullsized":"2024-03-23T23:58:16.593896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593951+0000","last_change":"2024-03-23T23:56:30.876574+0000","last_active":"2024-03-23T23:58:16.593951+0000","last_peered":"2024-03-23T23:58:16.593951+0000","last_clean":"2024-03-23T23:58:16.593951+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:58:16.593951+0000","last_undegraded":"2024-03-23T23:58:16.593951+0000","last_fullsized":"2024-03-23T23:58:16.593951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569976+0000","last_change":"2024-03-23T23:56:29.894494+0000","last_active":"2024-03-23T23:58:16.569976+0000","last_peered":"2024-03-23T23:58:16.569976+0000","last_clean":"2024-03-23T23:58:16.569976+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:58:16.569976+0000","last_undegraded":"2024-03-23T23:58:16.569976+0000","last_fullsized":"2024-03-23T23:58:16.569976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595145+0000","last_change":"2024-03-23T23:56:30.891335+0000","last_active":"2024-03-23T23:58:16.595145+0000","last_peered":"2024-03-23T23:58:16.595145+0000","last_clean":"2024-03-23T23:58:16.595145+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:58:16.595145+0000","last_undegraded":"2024-03-23T23:58:16.595145+0000","last_fullsized":"2024-03-23T23:58:16.595145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595318+0000","last_change":"2024-03-23T23:56:29.886369+0000","last_active":"2024-03-23T23:58:16.595318+0000","last_peered":"2024-03-23T23:58:16.595318+0000","last_clean":"2024-03-23T23:58:16.595318+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:58:16.595318+0000","last_undegraded":"2024-03-23T23:58:16.595318+0000","last_fullsized":"2024-03-23T23:58:16.595318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596040+0000","last_change":"2024-03-23T23:56:30.876882+0000","last_active":"2024-03-23T23:58:16.596040+0000","last_peered":"2024-03-23T23:58:16.596040+0000","last_clean":"2024-03-23T23:58:16.596040+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:58:16.596040+0000","last_undegraded":"2024-03-23T23:58:16.596040+0000","last_fullsized":"2024-03-23T23:58:16.596040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'9","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595896+0000","last_change":"2024-03-23T23:56:29.886611+0000","last_active":"2024-03-23T23:58:16.595896+0000","last_peered":"2024-03-23T23:58:16.595896+0000","last_clean":"2024-03-23T23:58:16.595896+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:58:16.595896+0000","last_undegraded":"2024-03-23T23:58:16.595896+0000","last_fullsized":"2024-03-23T23:58:16.595896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571209+0000","last_change":"2024-03-23T23:56:30.871258+0000","last_active":"2024-03-23T23:58:16.571209+0000","last_peered":"2024-03-23T23:58:16.571209+0000","last_clean":"2024-03-23T23:58:16.571209+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:58:16.571209+0000","last_undegraded":"2024-03-23T23:58:16.571209+0000","last_fullsized":"2024-03-23T23:58:16.571209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:12.879233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'65","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569445+0000","last_change":"2024-03-23T23:56:29.886316+0000","last_active":"2024-03-23T23:58:16.569445+0000","last_peered":"2024-03-23T23:58:16.569445+0000","last_clean":"2024-03-23T23:58:16.569445+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:58:16.569445+0000","last_undegraded":"2024-03-23T23:58:16.569445+0000","last_fullsized":"2024-03-23T23:58:16.569445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596639+0000","last_change":"2024-03-23T23:56:30.885592+0000","last_active":"2024-03-23T23:58:16.596639+0000","last_peered":"2024-03-23T23:58:16.596639+0000","last_clean":"2024-03-23T23:58:16.596639+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:58:16.596639+0000","last_undegraded":"2024-03-23T23:58:16.596639+0000","last_fullsized":"2024-03-23T23:58:16.596639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595974+0000","last_change":"2024-03-23T23:56:29.891265+0000","last_active":"2024-03-23T23:58:16.595974+0000","last_peered":"2024-03-23T23:58:16.595974+0000","last_clean":"2024-03-23T23:58:16.595974+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:58:16.595974+0000","last_undegraded":"2024-03-23T23:58:16.595974+0000","last_fullsized":"2024-03-23T23:58:16.595974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:53.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594927+0000","last_change":"2024-03-23T23:56:30.886240+0000","last_active":"2024-03-23T23:58:16.594927+0000","last_peered":"2024-03-23T23:58:16.594927+0000","last_clean":"2024-03-23T23:58:16.594927+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:58:16.594927+0000","last_undegraded":"2024-03-23T23:58:16.594927+0000","last_fullsized":"2024-03-23T23:58:16.594927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594083+0000","last_change":"2024-03-23T23:56:29.890485+0000","last_active":"2024-03-23T23:58:16.594083+0000","last_peered":"2024-03-23T23:58:16.594083+0000","last_clean":"2024-03-23T23:58:16.594083+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:58:16.594083+0000","last_undegraded":"2024-03-23T23:58:16.594083+0000","last_fullsized":"2024-03-23T23:58:16.594083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595946+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:58:16.595946+0000","last_peered":"2024-03-23T23:58:16.595946+0000","last_clean":"2024-03-23T23:58:16.595946+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:58:16.595946+0000","last_undegraded":"2024-03-23T23:58:16.595946+0000","last_fullsized":"2024-03-23T23:58:16.595946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568289+0000","last_change":"2024-03-23T23:56:29.896833+0000","last_active":"2024-03-23T23:58:16.568289+0000","last_peered":"2024-03-23T23:58:16.568289+0000","last_clean":"2024-03-23T23:58:16.568289+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:58:16.568289+0000","last_undegraded":"2024-03-23T23:58:16.568289+0000","last_fullsized":"2024-03-23T23:58:16.568289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568088+0000","last_change":"2024-03-23T23:56:30.876178+0000","last_active":"2024-03-23T23:58:16.568088+0000","last_peered":"2024-03-23T23:58:16.568088+0000","last_clean":"2024-03-23T23:58:16.568088+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:58:16.568088+0000","last_undegraded":"2024-03-23T23:58:16.568088+0000","last_fullsized":"2024-03-23T23:58:16.568088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.565707+0000","last_change":"2024-03-23T23:56:29.879437+0000","last_active":"2024-03-23T23:58:16.565707+0000","last_peered":"2024-03-23T23:58:16.565707+0000","last_clean":"2024-03-23T23:58:16.565707+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:58:16.565707+0000","last_undegraded":"2024-03-23T23:58:16.565707+0000","last_fullsized":"2024-03-23T23:58:16.565707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595633+0000","last_change":"2024-03-23T23:56:30.888310+0000","last_active":"2024-03-23T23:58:16.595633+0000","last_peered":"2024-03-23T23:58:16.595633+0000","last_clean":"2024-03-23T23:58:16.595633+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:58:16.595633+0000","last_undegraded":"2024-03-23T23:58:16.595633+0000","last_fullsized":"2024-03-23T23:58:16.595633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.572015+0000","last_change":"2024-03-23T23:56:29.892548+0000","last_active":"2024-03-23T23:58:16.572015+0000","last_peered":"2024-03-23T23:58:16.572015+0000","last_clean":"2024-03-23T23:58:16.572015+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:58:16.572015+0000","last_undegraded":"2024-03-23T23:58:16.572015+0000","last_fullsized":"2024-03-23T23:58:16.572015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:53:30.285127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596206+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:58:16.596206+0000","last_peered":"2024-03-23T23:58:16.596206+0000","last_clean":"2024-03-23T23:58:16.596206+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:58:16.596206+0000","last_undegraded":"2024-03-23T23:58:16.596206+0000","last_fullsized":"2024-03-23T23:58:16.596206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566992+0000","last_change":"2024-03-23T23:56:29.883486+0000","last_active":"2024-03-23T23:58:16.566992+0000","last_peered":"2024-03-23T23:58:16.566992+0000","last_clean":"2024-03-23T23:58:16.566992+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:58:16.566992+0000","last_undegraded":"2024-03-23T23:58:16.566992+0000","last_fullsized":"2024-03-23T23:58:16.566992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596565+0000","last_change":"2024-03-23T23:56:30.887560+0000","last_active":"2024-03-23T23:58:16.596565+0000","last_peered":"2024-03-23T23:58:16.596565+0000","last_clean":"2024-03-23T23:58:16.596565+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:58:16.596565+0000","last_undegraded":"2024-03-23T23:58:16.596565+0000","last_fullsized":"2024-03-23T23:58:16.596565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596103+0000","last_change":"2024-03-23T23:56:29.897890+0000","last_active":"2024-03-23T23:58:16.596103+0000","last_peered":"2024-03-23T23:58:16.596103+0000","last_clean":"2024-03-23T23:58:16.596103+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:58:16.596103+0000","last_undegraded":"2024-03-23T23:58:16.596103+0000","last_fullsized":"2024-03-23T23:58:16.596103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594421+0000","last_change":"2024-03-23T23:56:30.888006+0000","last_active":"2024-03-23T23:58:16.594421+0000","last_peered":"2024-03-23T23:58:16.594421+0000","last_clean":"2024-03-23T23:58:16.594421+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:58:16.594421+0000","last_undegraded":"2024-03-23T23:58:16.594421+0000","last_fullsized":"2024-03-23T23:58:16.594421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566500+0000","last_change":"2024-03-23T23:56:29.888464+0000","last_active":"2024-03-23T23:58:16.566500+0000","last_peered":"2024-03-23T23:58:16.566500+0000","last_clean":"2024-03-23T23:58:16.566500+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:58:16.566500+0000","last_undegraded":"2024-03-23T23:58:16.566500+0000","last_fullsized":"2024-03-23T23:58:16.566500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596781+0000","last_change":"2024-03-23T23:56:30.883536+0000","last_active":"2024-03-23T23:58:16.596781+0000","last_peered":"2024-03-23T23:58:16.596781+0000","last_clean":"2024-03-23T23:58:16.596781+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:58:16.596781+0000","last_undegraded":"2024-03-23T23:58:16.596781+0000","last_fullsized":"2024-03-23T23:58:16.596781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:30:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594838+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:58:16.594838+0000","last_peered":"2024-03-23T23:58:16.594838+0000","last_clean":"2024-03-23T23:58:16.594838+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:58:16.594838+0000","last_undegraded":"2024-03-23T23:58:16.594838+0000","last_fullsized":"2024-03-23T23:58:16.594838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593648+0000","last_change":"2024-03-23T23:56:29.886033+0000","last_active":"2024-03-23T23:58:16.593648+0000","last_peered":"2024-03-23T23:58:16.593648+0000","last_clean":"2024-03-23T23:58:16.593648+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:58:16.593648+0000","last_undegraded":"2024-03-23T23:58:16.593648+0000","last_fullsized":"2024-03-23T23:58:16.593648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577750+0000","last_change":"2024-03-23T23:56:30.883752+0000","last_active":"2024-03-23T23:58:16.577750+0000","last_peered":"2024-03-23T23:58:16.577750+0000","last_clean":"2024-03-23T23:58:16.577750+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:58:16.577750+0000","last_undegraded":"2024-03-23T23:58:16.577750+0000","last_fullsized":"2024-03-23T23:58:16.577750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594644+0000","last_change":"2024-03-23T23:56:29.881565+0000","last_active":"2024-03-23T23:58:16.594644+0000","last_peered":"2024-03-23T23:58:16.594644+0000","last_clean":"2024-03-23T23:58:16.594644+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:58:16.594644+0000","last_undegraded":"2024-03-23T23:58:16.594644+0000","last_fullsized":"2024-03-23T23:58:16.594644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595095+0000","last_change":"2024-03-23T23:56:30.886503+0000","last_active":"2024-03-23T23:58:16.595095+0000","last_peered":"2024-03-23T23:58:16.595095+0000","last_clean":"2024-03-23T23:58:16.595095+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:58:16.595095+0000","last_undegraded":"2024-03-23T23:58:16.595095+0000","last_fullsized":"2024-03-23T23:58:16.595095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:02:03.136599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'8","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:17.065078+0000","last_change":"2024-03-23T23:56:29.886668+0000","last_active":"2024-03-23T23:58:17.065078+0000","last_peered":"2024-03-23T23:58:17.065078+0000","last_clean":"2024-03-23T23:58:17.065078+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:58:17.065078+0000","last_undegraded":"2024-03-23T23:58:17.065078+0000","last_fullsized":"2024-03-23T23:58:17.065078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594097+0000","last_change":"2024-03-23T23:56:30.873826+0000","last_active":"2024-03-23T23:58:16.594097+0000","last_peered":"2024-03-23T23:58:16.594097+0000","last_clean":"2024-03-23T23:58:16.594097+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:58:16.594097+0000","last_undegraded":"2024-03-23T23:58:16.594097+0000","last_fullsized":"2024-03-23T23:58:16.594097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594310+0000","last_change":"2024-03-23T23:56:29.889635+0000","last_active":"2024-03-23T23:58:16.594310+0000","last_peered":"2024-03-23T23:58:16.594310+0000","last_clean":"2024-03-23T23:58:16.594310+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:58:16.594310+0000","last_undegraded":"2024-03-23T23:58:16.594310+0000","last_fullsized":"2024-03-23T23:58:16.594310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571197+0000","last_change":"2024-03-23T23:56:30.883369+0000","last_active":"2024-03-23T23:58:16.571197+0000","last_peered":"2024-03-23T23:58:16.571197+0000","last_clean":"2024-03-23T23:58:16.571197+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:58:16.571197+0000","last_undegraded":"2024-03-23T23:58:16.571197+0000","last_fullsized":"2024-03-23T23:58:16.571197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:12.049887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594935+0000","last_change":"2024-03-23T23:56:29.883626+0000","last_active":"2024-03-23T23:58:16.594935+0000","last_peered":"2024-03-23T23:58:16.594935+0000","last_clean":"2024-03-23T23:58:16.594935+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:58:16.594935+0000","last_undegraded":"2024-03-23T23:58:16.594935+0000","last_fullsized":"2024-03-23T23:58:16.594935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594655+0000","last_change":"2024-03-23T23:56:30.888942+0000","last_active":"2024-03-23T23:58:16.594655+0000","last_peered":"2024-03-23T23:58:16.594655+0000","last_clean":"2024-03-23T23:58:16.594655+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:58:16.594655+0000","last_undegraded":"2024-03-23T23:58:16.594655+0000","last_fullsized":"2024-03-23T23:58:16.594655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.597034+0000","last_change":"2024-03-23T23:56:29.886058+0000","last_active":"2024-03-23T23:58:16.597034+0000","last_peered":"2024-03-23T23:58:16.597034+0000","last_clean":"2024-03-23T23:58:16.597034+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:58:16.597034+0000","last_undegraded":"2024-03-23T23:58:16.597034+0000","last_fullsized":"2024-03-23T23:58:16.597034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:16.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594642+0000","last_change":"2024-03-23T23:56:30.878188+0000","last_active":"2024-03-23T23:58:16.594642+0000","last_peered":"2024-03-23T23:58:16.594642+0000","last_clean":"2024-03-23T23:58:16.594642+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:58:16.594642+0000","last_undegraded":"2024-03-23T23:58:16.594642+0000","last_fullsized":"2024-03-23T23:58:16.594642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595255+0000","last_change":"2024-03-23T23:56:29.884993+0000","last_active":"2024-03-23T23:58:16.595255+0000","last_peered":"2024-03-23T23:58:16.595255+0000","last_clean":"2024-03-23T23:58:16.595255+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:58:16.595255+0000","last_undegraded":"2024-03-23T23:58:16.595255+0000","last_fullsized":"2024-03-23T23:58:16.595255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566369+0000","last_change":"2024-03-23T23:57:11.228752+0000","last_active":"2024-03-23T23:58:16.566369+0000","last_peered":"2024-03-23T23:58:16.566369+0000","last_clean":"2024-03-23T23:58:16.566369+0000","last_became_active":"2024-03-23T23:57:11.227669+0000","last_became_peered":"2024-03-23T23:57:11.227669+0000","last_unstale":"2024-03-23T23:58:16.566369+0000","last_undegraded":"2024-03-23T23:58:16.566369+0000","last_fullsized":"2024-03-23T23:58:16.566369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.570023+0000","last_change":"2024-03-23T23:56:29.881331+0000","last_active":"2024-03-23T23:58:16.570023+0000","last_peered":"2024-03-23T23:58:16.570023+0000","last_clean":"2024-03-23T23:58:16.570023+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:58:16.570023+0000","last_undegraded":"2024-03-23T23:58:16.570023+0000","last_fullsized":"2024-03-23T23:58:16.570023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595989+0000","last_change":"2024-03-23T23:56:30.874453+0000","last_active":"2024-03-23T23:58:16.595989+0000","last_peered":"2024-03-23T23:58:16.595989+0000","last_clean":"2024-03-23T23:58:16.595989+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:58:16.595989+0000","last_undegraded":"2024-03-23T23:58:16.595989+0000","last_fullsized":"2024-03-23T23:58:16.595989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594425+0000","last_change":"2024-03-23T23:56:29.879862+0000","last_active":"2024-03-23T23:58:16.594425+0000","last_peered":"2024-03-23T23:58:16.594425+0000","last_clean":"2024-03-23T23:58:16.594425+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:58:16.594425+0000","last_undegraded":"2024-03-23T23:58:16.594425+0000","last_fullsized":"2024-03-23T23:58:16.594425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569771+0000","last_change":"2024-03-23T23:56:30.874693+0000","last_active":"2024-03-23T23:58:16.569771+0000","last_peered":"2024-03-23T23:58:16.569771+0000","last_clean":"2024-03-23T23:58:16.569771+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:58:16.569771+0000","last_undegraded":"2024-03-23T23:58:16.569771+0000","last_fullsized":"2024-03-23T23:58:16.569771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594558+0000","last_change":"2024-03-23T23:56:29.887900+0000","last_active":"2024-03-23T23:58:16.594558+0000","last_peered":"2024-03-23T23:58:16.594558+0000","last_clean":"2024-03-23T23:58:16.594558+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:58:16.594558+0000","last_undegraded":"2024-03-23T23:58:16.594558+0000","last_fullsized":"2024-03-23T23:58:16.594558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577351+0000","last_change":"2024-03-23T23:56:30.875932+0000","last_active":"2024-03-23T23:58:16.577351+0000","last_peered":"2024-03-23T23:58:16.577351+0000","last_clean":"2024-03-23T23:58:16.577351+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:58:16.577351+0000","last_undegraded":"2024-03-23T23:58:16.577351+0000","last_fullsized":"2024-03-23T23:58:16.577351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594461+0000","last_change":"2024-03-23T23:56:29.884727+0000","last_active":"2024-03-23T23:58:16.594461+0000","last_peered":"2024-03-23T23:58:16.594461+0000","last_clean":"2024-03-23T23:58:16.594461+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:58:16.594461+0000","last_undegraded":"2024-03-23T23:58:16.594461+0000","last_fullsized":"2024-03-23T23:58:16.594461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578130+0000","last_change":"2024-03-23T23:56:30.887213+0000","last_active":"2024-03-23T23:58:16.578130+0000","last_peered":"2024-03-23T23:58:16.578130+0000","last_clean":"2024-03-23T23:58:16.578130+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:58:16.578130+0000","last_undegraded":"2024-03-23T23:58:16.578130+0000","last_fullsized":"2024-03-23T23:58:16.578130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596027+0000","last_change":"2024-03-23T23:56:29.895498+0000","last_active":"2024-03-23T23:58:16.596027+0000","last_peered":"2024-03-23T23:58:16.596027+0000","last_clean":"2024-03-23T23:58:16.596027+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:58:16.596027+0000","last_undegraded":"2024-03-23T23:58:16.596027+0000","last_fullsized":"2024-03-23T23:58:16.596027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568366+0000","last_change":"2024-03-23T23:56:30.884001+0000","last_active":"2024-03-23T23:58:16.568366+0000","last_peered":"2024-03-23T23:58:16.568366+0000","last_clean":"2024-03-23T23:58:16.568366+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:58:16.568366+0000","last_undegraded":"2024-03-23T23:58:16.568366+0000","last_fullsized":"2024-03-23T23:58:16.568366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594334+0000","last_change":"2024-03-23T23:56:30.889155+0000","last_active":"2024-03-23T23:58:16.594334+0000","last_peered":"2024-03-23T23:58:16.594334+0000","last_clean":"2024-03-23T23:58:16.594334+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:58:16.594334+0000","last_undegraded":"2024-03-23T23:58:16.594334+0000","last_fullsized":"2024-03-23T23:58:16.594334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596405+0000","last_change":"2024-03-23T23:56:29.888617+0000","last_active":"2024-03-23T23:58:16.596405+0000","last_peered":"2024-03-23T23:58:16.596405+0000","last_clean":"2024-03-23T23:58:16.596405+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:58:16.596405+0000","last_undegraded":"2024-03-23T23:58:16.596405+0000","last_fullsized":"2024-03-23T23:58:16.596405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594138+0000","last_change":"2024-03-23T23:56:30.888308+0000","last_active":"2024-03-23T23:58:16.594138+0000","last_peered":"2024-03-23T23:58:16.594138+0000","last_clean":"2024-03-23T23:58:16.594138+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:58:16.594138+0000","last_undegraded":"2024-03-23T23:58:16.594138+0000","last_fullsized":"2024-03-23T23:58:16.594138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596826+0000","last_change":"2024-03-23T23:56:29.879942+0000","last_active":"2024-03-23T23:58:16.596826+0000","last_peered":"2024-03-23T23:58:16.596826+0000","last_clean":"2024-03-23T23:58:16.596826+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:58:16.596826+0000","last_undegraded":"2024-03-23T23:58:16.596826+0000","last_fullsized":"2024-03-23T23:58:16.596826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595895+0000","last_change":"2024-03-23T23:57:11.438439+0000","last_active":"2024-03-23T23:58:16.595895+0000","last_peered":"2024-03-23T23:58:16.595895+0000","last_clean":"2024-03-23T23:58:16.595895+0000","last_became_active":"2024-03-23T23:57:11.437365+0000","last_became_peered":"2024-03-23T23:57:11.437365+0000","last_unstale":"2024-03-23T23:58:16.595895+0000","last_undegraded":"2024-03-23T23:58:16.595895+0000","last_fullsized":"2024-03-23T23:58:16.595895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:30:27.781133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578142+0000","last_change":"2024-03-23T23:56:29.889380+0000","last_active":"2024-03-23T23:58:16.578142+0000","last_peered":"2024-03-23T23:58:16.578142+0000","last_clean":"2024-03-23T23:58:16.578142+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:58:16.578142+0000","last_undegraded":"2024-03-23T23:58:16.578142+0000","last_fullsized":"2024-03-23T23:58:16.578142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566771+0000","last_change":"2024-03-23T23:57:11.078716+0000","last_active":"2024-03-23T23:58:16.566771+0000","last_peered":"2024-03-23T23:58:16.566771+0000","last_clean":"2024-03-23T23:58:16.566771+0000","last_became_active":"2024-03-23T23:57:11.077960+0000","last_became_peered":"2024-03-23T23:57:11.077960+0000","last_unstale":"2024-03-23T23:58:16.566771+0000","last_undegraded":"2024-03-23T23:58:16.566771+0000","last_fullsized":"2024-03-23T23:58:16.566771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596412+0000","last_change":"2024-03-23T23:56:29.886266+0000","last_active":"2024-03-23T23:58:16.596412+0000","last_peered":"2024-03-23T23:58:16.596412+0000","last_clean":"2024-03-23T23:58:16.596412+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:58:16.596412+0000","last_undegraded":"2024-03-23T23:58:16.596412+0000","last_fullsized":"2024-03-23T23:58:16.596412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68282,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":120,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":136564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":684848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":160675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":93988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":94024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":161382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":684904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:23.955 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-23T23:58:23.955 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:24.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.188+0000 7f4249c00640 1 Processor -- start 2024-03-23T23:58:24.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.189+0000 7f4249c00640 1 -- start start 2024-03-23T23:58:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.190+0000 7f4249c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42440b50a0 0x7f4244141510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.190+0000 7f4249c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440b4590 con 0x7f42440b41b0 2024-03-23T23:58:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.190+0000 7f4249c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440b56c0 con 0x7f42440b6d30 2024-03-23T23:58:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.190+0000 7f4249c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42440b9930 con 0x7f42440b50a0 2024-03-23T23:58:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.190+0000 7f4243e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f42440b41b0 0x7f42441471e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46700/0 (socket says 172.21.15.31:46700) 2024-03-23T23:58:24.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.190+0000 7f4243e00640 1 -- 172.21.15.31:0/1903787562 learned_addr learned my addr 172.21.15.31:0/1903787562 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.190+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613493237 0 0) 0x7f42440b4590 con 0x7f42440b41b0 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4228003520 con 0x7f42440b41b0 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4249200640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42440b50a0 0x7f4244141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 415330662 0 0) 0x7f4228003520 con 0x7f42440b41b0 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42440b50a0 msgr2=0x7f4244141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42440b50a0 0x7f4244141510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 >> v1:172.21.15.59:6789/0 conn(0x7f42440b6d30 legacy=0x7f4244140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440b9c10 con 0x7f42440b41b0 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f4234001670 con 0x7f42440b41b0 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 >> v1:172.21.15.31:6789/0 conn(0x7f42440b41b0 legacy=0x7f42441471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4228003a50 0x7f4228003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42440b50a0 0x7f4228004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228004d40 0x7f42280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42440b9930 con 0x7f4228003a50 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422800bad0 con 0x7f4228004d40 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422800bcd0 con 0x7f42440b50a0 2024-03-23T23:58:24.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.191+0000 7f4243e00640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4228003a50 0x7f4228003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.192+0000 7f4243e00640 1 -- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42440b50a0 msgr2=0x7f4228004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.192+0000 7f4243e00640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42440b50a0 0x7f4228004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.192+0000 7f4243e00640 1 -- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228004d40 msgr2=0x7f42280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.192+0000 7f4243e00640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4228004d40 0x7f42280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.192+0000 7f4243e00640 1 -- 172.21.15.31:0/1903787562 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228003520 con 0x7f4228003a50 2024-03-23T23:58:24.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.193+0000 7f4243e00640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4228003a50 0x7f4228003e70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f423400c210 tx=0x7f4228005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995b7e8526334bf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.193+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234007cf0 con 0x7f4228003a50 2024-03-23T23:58:24.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.193+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4234030070 con 0x7f4228003a50 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.193+0000 7f4243400640 1 -- 172.21.15.31:0/1903787562 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234005d30 con 0x7f4228003a50 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.193+0000 7f4249c00640 1 -- 172.21.15.31:0/1903787562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4228003a50 msgr2=0x7f4228003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.193+0000 7f4249c00640 1 --2- 172.21.15.31:0/1903787562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4228003a50 0x7f4228003e70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f423400c210 tx=0x7f4228005830 comp rx=0 tx=0).stop 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.194+0000 7f4249200640 1 -- 172.21.15.31:0/1903787562 reap_dead start 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.194+0000 7f4249c00640 1 -- 172.21.15.31:0/1903787562 shutdown_connections 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.194+0000 7f4249c00640 1 -- 172.21.15.31:0/1903787562 >> 172.21.15.31:0/1903787562 conn(0x7f4244066fb0 msgr2=0x7f42440673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.194+0000 7f4249c00640 1 -- 172.21.15.31:0/1903787562 shutdown_connections 2024-03-23T23:58:24.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.194+0000 7f4249c00640 1 -- 172.21.15.31:0/1903787562 wait complete. 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.195+0000 7f4249c00640 1 Processor -- start 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.195+0000 7f4249c00640 1 -- start start 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.196+0000 7f4249c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4228003a50 0x7f4244149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.196+0000 7f4249c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424414a920 0x7f42441dce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.196+0000 7f4249c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42441dd380 0x7f4244136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.196+0000 7f4249c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244147a70 con 0x7f424414a920 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.196+0000 7f4249c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441478f0 con 0x7f42441dd380 2024-03-23T23:58:24.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.196+0000 7f4249c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4244141510 con 0x7f4228003a50 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.196+0000 7f423be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424414a920 0x7f42441dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424414a920 0x7f42441dce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:33674/0 (socket says 172.21.15.31:33674) 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 -- 172.21.15.31:0/3574907777 learned_addr learned my addr 172.21.15.31:0/3574907777 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f4243e00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4228003a50 0x7f4244149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f4249200640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42441dd380 0x7f4244136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 -- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4228003a50 msgr2=0x7f4244149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4228003a50 0x7f4244149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 -- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42441dd380 msgr2=0x7f4244136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42441dd380 0x7f4244136bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 -- 172.21.15.31:0/3574907777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4244137aa0 con 0x7f424414a920 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f4249200640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42441dd380 0x7f4244136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f423be00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424414a920 0x7f42441dce40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c4d0 tx=0x7f422c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.197+0000 7f4240c00640 1 -- 172.21.15.31:0/3574907777 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0052d0 con 0x7f424414a920 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.198+0000 7f4240c00640 1 -- 172.21.15.31:0/3574907777 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c005470 con 0x7f424414a920 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.198+0000 7f4240c00640 1 -- 172.21.15.31:0/3574907777 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c012850 con 0x7f424414a920 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.198+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424414ae70 con 0x7f424414a920 2024-03-23T23:58:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.198+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424414b5e0 con 0x7f424414a920 2024-03-23T23:58:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.199+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42440752c0 con 0x7f424414a920 2024-03-23T23:58:24.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.200+0000 7f4240c00640 1 -- 172.21.15.31:0/3574907777 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f422c0129f0 con 0x7f424414a920 2024-03-23T23:58:24.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.201+0000 7f4240c00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f422006bbd0 0x7f422006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.201+0000 7f4240c00640 1 -- 172.21.15.31:0/3574907777 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f422c08a730 con 0x7f424414a920 2024-03-23T23:58:24.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.201+0000 7f4243e00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f422006bbd0 0x7f422006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.202+0000 7f4243e00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f422006bbd0 0x7f422006e090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4234034000 tx=0x7f4234007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.205+0000 7f4240c00640 1 -- 172.21.15.31:0/3574907777 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f422c059210 con 0x7f424414a920 2024-03-23T23:58:24.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.407+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4244145b90 con 0x7f422006bbd0 2024-03-23T23:58:24.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.425+0000 7f4240c00640 1 -- 172.21.15.31:0/3574907777 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251981 (secure 0 0 0) 0x7f4234082860 con 0x7f422006bbd0 2024-03-23T23:58:24.429 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:58:24.430 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:58:24.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.431+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f422006bbd0 msgr2=0x7f422006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.431+0000 7f4249c00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f422006bbd0 0x7f422006e090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4234034000 tx=0x7f4234007000 comp rx=0 tx=0).stop 2024-03-23T23:58:24.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.431+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424414a920 msgr2=0x7f42441dce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.431+0000 7f4249c00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424414a920 0x7f42441dce40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c4d0 tx=0x7f422c00c990 comp rx=0 tx=0).stop 2024-03-23T23:58:24.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 shutdown_connections 2024-03-23T23:58:24.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f422006bbd0 0x7f422006e090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42441dd380 0x7f4244136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f424414a920 0x7f42441dce40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 --2- 172.21.15.31:0/3574907777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4228003a50 0x7f4244149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 >> 172.21.15.31:0/3574907777 conn(0x7f4244066fb0 msgr2=0x7f4244140340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 shutdown_connections 2024-03-23T23:58:24.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.432+0000 7f4249c00640 1 -- 172.21.15.31:0/3574907777 wait complete. 2024-03-23T23:58:24.450 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-03-23T23:58:23.370129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658650,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":123,"num_read_kb":107,"num_write":287,"num_write_kb":2546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":248,"ondisk_log_size":248,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3344,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3424256,"data_stored":2068484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":65872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":83,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.012889"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595965+0000","last_change":"2024-03-23T23:56:30.885878+0000","last_active":"2024-03-23T23:58:16.595965+0000","last_peered":"2024-03-23T23:58:16.595965+0000","last_clean":"2024-03-23T23:58:16.595965+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:58:16.595965+0000","last_undegraded":"2024-03-23T23:58:16.595965+0000","last_fullsized":"2024-03-23T23:58:16.595965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594966+0000","last_change":"2024-03-23T23:56:30.875303+0000","last_active":"2024-03-23T23:58:16.594966+0000","last_peered":"2024-03-23T23:58:16.594966+0000","last_clean":"2024-03-23T23:58:16.594966+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:58:16.594966+0000","last_undegraded":"2024-03-23T23:58:16.594966+0000","last_fullsized":"2024-03-23T23:58:16.594966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595393+0000","last_change":"2024-03-23T23:56:30.883893+0000","last_active":"2024-03-23T23:58:16.595393+0000","last_peered":"2024-03-23T23:58:16.595393+0000","last_clean":"2024-03-23T23:58:16.595393+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:58:16.595393+0000","last_undegraded":"2024-03-23T23:58:16.595393+0000","last_fullsized":"2024-03-23T23:58:16.595393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593882+0000","last_change":"2024-03-23T23:56:30.891008+0000","last_active":"2024-03-23T23:58:16.593882+0000","last_peered":"2024-03-23T23:58:16.593882+0000","last_clean":"2024-03-23T23:58:16.593882+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:58:16.593882+0000","last_undegraded":"2024-03-23T23:58:16.593882+0000","last_fullsized":"2024-03-23T23:58:16.593882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595756+0000","last_change":"2024-03-23T23:56:30.877242+0000","last_active":"2024-03-23T23:58:16.595756+0000","last_peered":"2024-03-23T23:58:16.595756+0000","last_clean":"2024-03-23T23:58:16.595756+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:58:16.595756+0000","last_undegraded":"2024-03-23T23:58:16.595756+0000","last_fullsized":"2024-03-23T23:58:16.595756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593683+0000","last_change":"2024-03-23T23:56:30.890268+0000","last_active":"2024-03-23T23:58:16.593683+0000","last_peered":"2024-03-23T23:58:16.593683+0000","last_clean":"2024-03-23T23:58:16.593683+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:58:16.593683+0000","last_undegraded":"2024-03-23T23:58:16.593683+0000","last_fullsized":"2024-03-23T23:58:16.593683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595327+0000","last_change":"2024-03-23T23:56:30.885059+0000","last_active":"2024-03-23T23:58:16.595327+0000","last_peered":"2024-03-23T23:58:16.595327+0000","last_clean":"2024-03-23T23:58:16.595327+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:58:16.595327+0000","last_undegraded":"2024-03-23T23:58:16.595327+0000","last_fullsized":"2024-03-23T23:58:16.595327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577052+0000","last_change":"2024-03-23T23:56:30.881077+0000","last_active":"2024-03-23T23:58:16.577052+0000","last_peered":"2024-03-23T23:58:16.577052+0000","last_clean":"2024-03-23T23:58:16.577052+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:58:16.577052+0000","last_undegraded":"2024-03-23T23:58:16.577052+0000","last_fullsized":"2024-03-23T23:58:16.577052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596322+0000","last_change":"2024-03-23T23:56:30.883587+0000","last_active":"2024-03-23T23:58:16.596322+0000","last_peered":"2024-03-23T23:58:16.596322+0000","last_clean":"2024-03-23T23:58:16.596322+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:58:16.596322+0000","last_undegraded":"2024-03-23T23:58:16.596322+0000","last_fullsized":"2024-03-23T23:58:16.596322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569767+0000","last_change":"2024-03-23T23:56:30.888454+0000","last_active":"2024-03-23T23:58:16.569767+0000","last_peered":"2024-03-23T23:58:16.569767+0000","last_clean":"2024-03-23T23:58:16.569767+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:58:16.569767+0000","last_undegraded":"2024-03-23T23:58:16.569767+0000","last_fullsized":"2024-03-23T23:58:16.569767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569177+0000","last_change":"2024-03-23T23:56:30.881125+0000","last_active":"2024-03-23T23:58:16.569177+0000","last_peered":"2024-03-23T23:58:16.569177+0000","last_clean":"2024-03-23T23:58:16.569177+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:58:16.569177+0000","last_undegraded":"2024-03-23T23:58:16.569177+0000","last_fullsized":"2024-03-23T23:58:16.569177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571428+0000","last_change":"2024-03-23T23:56:30.863287+0000","last_active":"2024-03-23T23:58:16.571428+0000","last_peered":"2024-03-23T23:58:16.571428+0000","last_clean":"2024-03-23T23:58:16.571428+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:58:16.571428+0000","last_undegraded":"2024-03-23T23:58:16.571428+0000","last_fullsized":"2024-03-23T23:58:16.571428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:00.178139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577989+0000","last_change":"2024-03-23T23:56:30.881169+0000","last_active":"2024-03-23T23:58:16.577989+0000","last_peered":"2024-03-23T23:58:16.577989+0000","last_clean":"2024-03-23T23:58:16.577989+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:58:16.577989+0000","last_undegraded":"2024-03-23T23:58:16.577989+0000","last_fullsized":"2024-03-23T23:58:16.577989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"23'2","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594573+0000","last_change":"2024-03-23T23:56:30.876653+0000","last_active":"2024-03-23T23:58:16.594573+0000","last_peered":"2024-03-23T23:58:16.594573+0000","last_clean":"2024-03-23T23:58:16.594573+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:58:16.594573+0000","last_undegraded":"2024-03-23T23:58:16.594573+0000","last_fullsized":"2024-03-23T23:58:16.594573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:58:31.705987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594270+0000","last_change":"2024-03-23T23:56:30.862687+0000","last_active":"2024-03-23T23:58:16.594270+0000","last_peered":"2024-03-23T23:58:16.594270+0000","last_clean":"2024-03-23T23:58:16.594270+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:58:16.594270+0000","last_undegraded":"2024-03-23T23:58:16.594270+0000","last_fullsized":"2024-03-23T23:58:16.594270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"23'3","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593485+0000","last_change":"2024-03-23T23:56:30.882976+0000","last_active":"2024-03-23T23:58:16.593485+0000","last_peered":"2024-03-23T23:58:16.593485+0000","last_clean":"2024-03-23T23:58:16.593485+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:58:16.593485+0000","last_undegraded":"2024-03-23T23:58:16.593485+0000","last_fullsized":"2024-03-23T23:58:16.593485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595393+0000","last_change":"2024-03-23T23:56:30.895060+0000","last_active":"2024-03-23T23:58:16.595393+0000","last_peered":"2024-03-23T23:58:16.595393+0000","last_clean":"2024-03-23T23:58:16.595393+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:58:16.595393+0000","last_undegraded":"2024-03-23T23:58:16.595393+0000","last_fullsized":"2024-03-23T23:58:16.595393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566792+0000","last_change":"2024-03-23T23:56:30.892332+0000","last_active":"2024-03-23T23:58:16.566792+0000","last_peered":"2024-03-23T23:58:16.566792+0000","last_clean":"2024-03-23T23:58:16.566792+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:58:16.566792+0000","last_undegraded":"2024-03-23T23:58:16.566792+0000","last_fullsized":"2024-03-23T23:58:16.566792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596924+0000","last_change":"2024-03-23T23:56:30.881290+0000","last_active":"2024-03-23T23:58:16.596924+0000","last_peered":"2024-03-23T23:58:16.596924+0000","last_clean":"2024-03-23T23:58:16.596924+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:58:16.596924+0000","last_undegraded":"2024-03-23T23:58:16.596924+0000","last_fullsized":"2024-03-23T23:58:16.596924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:54:18.265054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568869+0000","last_change":"2024-03-23T23:56:30.875425+0000","last_active":"2024-03-23T23:58:16.568869+0000","last_peered":"2024-03-23T23:58:16.568869+0000","last_clean":"2024-03-23T23:58:16.568869+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:58:16.568869+0000","last_undegraded":"2024-03-23T23:58:16.568869+0000","last_fullsized":"2024-03-23T23:58:16.568869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595497+0000","last_change":"2024-03-23T23:56:30.884434+0000","last_active":"2024-03-23T23:58:16.595497+0000","last_peered":"2024-03-23T23:58:16.595497+0000","last_clean":"2024-03-23T23:58:16.595497+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:58:16.595497+0000","last_undegraded":"2024-03-23T23:58:16.595497+0000","last_fullsized":"2024-03-23T23:58:16.595497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566046+0000","last_change":"2024-03-23T23:57:11.230601+0000","last_active":"2024-03-23T23:58:16.566046+0000","last_peered":"2024-03-23T23:58:16.566046+0000","last_clean":"2024-03-23T23:58:16.566046+0000","last_became_active":"2024-03-23T23:57:11.229498+0000","last_became_peered":"2024-03-23T23:57:11.229498+0000","last_unstale":"2024-03-23T23:58:16.566046+0000","last_undegraded":"2024-03-23T23:58:16.566046+0000","last_fullsized":"2024-03-23T23:58:16.566046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577112+0000","last_change":"2024-03-23T23:56:30.888046+0000","last_active":"2024-03-23T23:58:16.577112+0000","last_peered":"2024-03-23T23:58:16.577112+0000","last_clean":"2024-03-23T23:58:16.577112+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:58:16.577112+0000","last_undegraded":"2024-03-23T23:58:16.577112+0000","last_fullsized":"2024-03-23T23:58:16.577112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593652+0000","last_change":"2024-03-23T23:56:30.886470+0000","last_active":"2024-03-23T23:58:16.593652+0000","last_peered":"2024-03-23T23:58:16.593652+0000","last_clean":"2024-03-23T23:58:16.593652+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:58:16.593652+0000","last_undegraded":"2024-03-23T23:58:16.593652+0000","last_fullsized":"2024-03-23T23:58:16.593652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578500+0000","last_change":"2024-03-23T23:56:30.885446+0000","last_active":"2024-03-23T23:58:16.578500+0000","last_peered":"2024-03-23T23:58:16.578500+0000","last_clean":"2024-03-23T23:58:16.578500+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:58:16.578500+0000","last_undegraded":"2024-03-23T23:58:16.578500+0000","last_fullsized":"2024-03-23T23:58:16.578500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569912+0000","last_change":"2024-03-23T23:56:30.882609+0000","last_active":"2024-03-23T23:58:16.569912+0000","last_peered":"2024-03-23T23:58:16.569912+0000","last_clean":"2024-03-23T23:58:16.569912+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:58:16.569912+0000","last_undegraded":"2024-03-23T23:58:16.569912+0000","last_fullsized":"2024-03-23T23:58:16.569912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"23'2","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595435+0000","last_change":"2024-03-23T23:56:30.881031+0000","last_active":"2024-03-23T23:58:16.595435+0000","last_peered":"2024-03-23T23:58:16.595435+0000","last_clean":"2024-03-23T23:58:16.595435+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:58:16.595435+0000","last_undegraded":"2024-03-23T23:58:16.595435+0000","last_fullsized":"2024-03-23T23:58:16.595435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577895+0000","last_change":"2024-03-23T23:56:30.887942+0000","last_active":"2024-03-23T23:58:16.577895+0000","last_peered":"2024-03-23T23:58:16.577895+0000","last_clean":"2024-03-23T23:58:16.577895+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:58:16.577895+0000","last_undegraded":"2024-03-23T23:58:16.577895+0000","last_fullsized":"2024-03-23T23:58:16.577895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595661+0000","last_change":"2024-03-23T23:56:30.882527+0000","last_active":"2024-03-23T23:58:16.595661+0000","last_peered":"2024-03-23T23:58:16.595661+0000","last_clean":"2024-03-23T23:58:16.595661+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:58:16.595661+0000","last_undegraded":"2024-03-23T23:58:16.595661+0000","last_fullsized":"2024-03-23T23:58:16.595661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593754+0000","last_change":"2024-03-23T23:56:30.885451+0000","last_active":"2024-03-23T23:58:16.593754+0000","last_peered":"2024-03-23T23:58:16.593754+0000","last_clean":"2024-03-23T23:58:16.593754+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:58:16.593754+0000","last_undegraded":"2024-03-23T23:58:16.593754+0000","last_fullsized":"2024-03-23T23:58:16.593754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.565795+0000","last_change":"2024-03-23T23:56:30.880152+0000","last_active":"2024-03-23T23:58:16.565795+0000","last_peered":"2024-03-23T23:58:16.565795+0000","last_clean":"2024-03-23T23:58:16.565795+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:58:16.565795+0000","last_undegraded":"2024-03-23T23:58:16.565795+0000","last_fullsized":"2024-03-23T23:58:16.565795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:17.288541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.567816+0000","last_change":"2024-03-23T23:56:30.880378+0000","last_active":"2024-03-23T23:58:16.567816+0000","last_peered":"2024-03-23T23:58:16.567816+0000","last_clean":"2024-03-23T23:58:16.567816+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:58:16.567816+0000","last_undegraded":"2024-03-23T23:58:16.567816+0000","last_fullsized":"2024-03-23T23:58:16.567816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.570223+0000","last_change":"2024-03-23T23:56:30.869148+0000","last_active":"2024-03-23T23:58:16.570223+0000","last_peered":"2024-03-23T23:58:16.570223+0000","last_clean":"2024-03-23T23:58:16.570223+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:58:16.570223+0000","last_undegraded":"2024-03-23T23:58:16.570223+0000","last_fullsized":"2024-03-23T23:58:16.570223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:38.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578452+0000","last_change":"2024-03-23T23:56:29.890549+0000","last_active":"2024-03-23T23:58:16.578452+0000","last_peered":"2024-03-23T23:58:16.578452+0000","last_clean":"2024-03-23T23:58:16.578452+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:58:16.578452+0000","last_undegraded":"2024-03-23T23:58:16.578452+0000","last_fullsized":"2024-03-23T23:58:16.578452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595774+0000","last_change":"2024-03-23T23:56:30.885979+0000","last_active":"2024-03-23T23:58:16.595774+0000","last_peered":"2024-03-23T23:58:16.595774+0000","last_clean":"2024-03-23T23:58:16.595774+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:58:16.595774+0000","last_undegraded":"2024-03-23T23:58:16.595774+0000","last_fullsized":"2024-03-23T23:58:16.595774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568569+0000","last_change":"2024-03-23T23:56:29.892444+0000","last_active":"2024-03-23T23:58:16.568569+0000","last_peered":"2024-03-23T23:58:16.568569+0000","last_clean":"2024-03-23T23:58:16.568569+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:58:16.568569+0000","last_undegraded":"2024-03-23T23:58:16.568569+0000","last_fullsized":"2024-03-23T23:58:16.568569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577429+0000","last_change":"2024-03-23T23:56:29.887065+0000","last_active":"2024-03-23T23:58:16.577429+0000","last_peered":"2024-03-23T23:58:16.577429+0000","last_clean":"2024-03-23T23:58:16.577429+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:58:16.577429+0000","last_undegraded":"2024-03-23T23:58:16.577429+0000","last_fullsized":"2024-03-23T23:58:16.577429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:05:45.290286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577241+0000","last_change":"2024-03-23T23:56:30.881409+0000","last_active":"2024-03-23T23:58:16.577241+0000","last_peered":"2024-03-23T23:58:16.577241+0000","last_clean":"2024-03-23T23:58:16.577241+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:58:16.577241+0000","last_undegraded":"2024-03-23T23:58:16.577241+0000","last_fullsized":"2024-03-23T23:58:16.577241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593896+0000","last_change":"2024-03-23T23:56:29.897340+0000","last_active":"2024-03-23T23:58:16.593896+0000","last_peered":"2024-03-23T23:58:16.593896+0000","last_clean":"2024-03-23T23:58:16.593896+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:58:16.593896+0000","last_undegraded":"2024-03-23T23:58:16.593896+0000","last_fullsized":"2024-03-23T23:58:16.593896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593951+0000","last_change":"2024-03-23T23:56:30.876574+0000","last_active":"2024-03-23T23:58:16.593951+0000","last_peered":"2024-03-23T23:58:16.593951+0000","last_clean":"2024-03-23T23:58:16.593951+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:58:16.593951+0000","last_undegraded":"2024-03-23T23:58:16.593951+0000","last_fullsized":"2024-03-23T23:58:16.593951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569976+0000","last_change":"2024-03-23T23:56:29.894494+0000","last_active":"2024-03-23T23:58:16.569976+0000","last_peered":"2024-03-23T23:58:16.569976+0000","last_clean":"2024-03-23T23:58:16.569976+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:58:16.569976+0000","last_undegraded":"2024-03-23T23:58:16.569976+0000","last_fullsized":"2024-03-23T23:58:16.569976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595145+0000","last_change":"2024-03-23T23:56:30.891335+0000","last_active":"2024-03-23T23:58:16.595145+0000","last_peered":"2024-03-23T23:58:16.595145+0000","last_clean":"2024-03-23T23:58:16.595145+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:58:16.595145+0000","last_undegraded":"2024-03-23T23:58:16.595145+0000","last_fullsized":"2024-03-23T23:58:16.595145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595318+0000","last_change":"2024-03-23T23:56:29.886369+0000","last_active":"2024-03-23T23:58:16.595318+0000","last_peered":"2024-03-23T23:58:16.595318+0000","last_clean":"2024-03-23T23:58:16.595318+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:58:16.595318+0000","last_undegraded":"2024-03-23T23:58:16.595318+0000","last_fullsized":"2024-03-23T23:58:16.595318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596040+0000","last_change":"2024-03-23T23:56:30.876882+0000","last_active":"2024-03-23T23:58:16.596040+0000","last_peered":"2024-03-23T23:58:16.596040+0000","last_clean":"2024-03-23T23:58:16.596040+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:58:16.596040+0000","last_undegraded":"2024-03-23T23:58:16.596040+0000","last_fullsized":"2024-03-23T23:58:16.596040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'9","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595896+0000","last_change":"2024-03-23T23:56:29.886611+0000","last_active":"2024-03-23T23:58:16.595896+0000","last_peered":"2024-03-23T23:58:16.595896+0000","last_clean":"2024-03-23T23:58:16.595896+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:58:16.595896+0000","last_undegraded":"2024-03-23T23:58:16.595896+0000","last_fullsized":"2024-03-23T23:58:16.595896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571209+0000","last_change":"2024-03-23T23:56:30.871258+0000","last_active":"2024-03-23T23:58:16.571209+0000","last_peered":"2024-03-23T23:58:16.571209+0000","last_clean":"2024-03-23T23:58:16.571209+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:58:16.571209+0000","last_undegraded":"2024-03-23T23:58:16.571209+0000","last_fullsized":"2024-03-23T23:58:16.571209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:12.879233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'65","reported_seq":85,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569445+0000","last_change":"2024-03-23T23:56:29.886316+0000","last_active":"2024-03-23T23:58:16.569445+0000","last_peered":"2024-03-23T23:58:16.569445+0000","last_clean":"2024-03-23T23:58:16.569445+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:58:16.569445+0000","last_undegraded":"2024-03-23T23:58:16.569445+0000","last_fullsized":"2024-03-23T23:58:16.569445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66777,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596639+0000","last_change":"2024-03-23T23:56:30.885592+0000","last_active":"2024-03-23T23:58:16.596639+0000","last_peered":"2024-03-23T23:58:16.596639+0000","last_clean":"2024-03-23T23:58:16.596639+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:58:16.596639+0000","last_undegraded":"2024-03-23T23:58:16.596639+0000","last_fullsized":"2024-03-23T23:58:16.596639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595974+0000","last_change":"2024-03-23T23:56:29.891265+0000","last_active":"2024-03-23T23:58:16.595974+0000","last_peered":"2024-03-23T23:58:16.595974+0000","last_clean":"2024-03-23T23:58:16.595974+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:58:16.595974+0000","last_undegraded":"2024-03-23T23:58:16.595974+0000","last_fullsized":"2024-03-23T23:58:16.595974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:01:53.538770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"23'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594927+0000","last_change":"2024-03-23T23:56:30.886240+0000","last_active":"2024-03-23T23:58:16.594927+0000","last_peered":"2024-03-23T23:58:16.594927+0000","last_clean":"2024-03-23T23:58:16.594927+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:58:16.594927+0000","last_undegraded":"2024-03-23T23:58:16.594927+0000","last_fullsized":"2024-03-23T23:58:16.594927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594083+0000","last_change":"2024-03-23T23:56:29.890485+0000","last_active":"2024-03-23T23:58:16.594083+0000","last_peered":"2024-03-23T23:58:16.594083+0000","last_clean":"2024-03-23T23:58:16.594083+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:58:16.594083+0000","last_undegraded":"2024-03-23T23:58:16.594083+0000","last_fullsized":"2024-03-23T23:58:16.594083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595946+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:58:16.595946+0000","last_peered":"2024-03-23T23:58:16.595946+0000","last_clean":"2024-03-23T23:58:16.595946+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:58:16.595946+0000","last_undegraded":"2024-03-23T23:58:16.595946+0000","last_fullsized":"2024-03-23T23:58:16.595946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568289+0000","last_change":"2024-03-23T23:56:29.896833+0000","last_active":"2024-03-23T23:58:16.568289+0000","last_peered":"2024-03-23T23:58:16.568289+0000","last_clean":"2024-03-23T23:58:16.568289+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:58:16.568289+0000","last_undegraded":"2024-03-23T23:58:16.568289+0000","last_fullsized":"2024-03-23T23:58:16.568289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568088+0000","last_change":"2024-03-23T23:56:30.876178+0000","last_active":"2024-03-23T23:58:16.568088+0000","last_peered":"2024-03-23T23:58:16.568088+0000","last_clean":"2024-03-23T23:58:16.568088+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:58:16.568088+0000","last_undegraded":"2024-03-23T23:58:16.568088+0000","last_fullsized":"2024-03-23T23:58:16.568088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.565707+0000","last_change":"2024-03-23T23:56:29.879437+0000","last_active":"2024-03-23T23:58:16.565707+0000","last_peered":"2024-03-23T23:58:16.565707+0000","last_clean":"2024-03-23T23:58:16.565707+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:58:16.565707+0000","last_undegraded":"2024-03-23T23:58:16.565707+0000","last_fullsized":"2024-03-23T23:58:16.565707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595633+0000","last_change":"2024-03-23T23:56:30.888310+0000","last_active":"2024-03-23T23:58:16.595633+0000","last_peered":"2024-03-23T23:58:16.595633+0000","last_clean":"2024-03-23T23:58:16.595633+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:58:16.595633+0000","last_undegraded":"2024-03-23T23:58:16.595633+0000","last_fullsized":"2024-03-23T23:58:16.595633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.572015+0000","last_change":"2024-03-23T23:56:29.892548+0000","last_active":"2024-03-23T23:58:16.572015+0000","last_peered":"2024-03-23T23:58:16.572015+0000","last_clean":"2024-03-23T23:58:16.572015+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:58:16.572015+0000","last_undegraded":"2024-03-23T23:58:16.572015+0000","last_fullsized":"2024-03-23T23:58:16.572015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:53:30.285127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596206+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:58:16.596206+0000","last_peered":"2024-03-23T23:58:16.596206+0000","last_clean":"2024-03-23T23:58:16.596206+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:58:16.596206+0000","last_undegraded":"2024-03-23T23:58:16.596206+0000","last_fullsized":"2024-03-23T23:58:16.596206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566992+0000","last_change":"2024-03-23T23:56:29.883486+0000","last_active":"2024-03-23T23:58:16.566992+0000","last_peered":"2024-03-23T23:58:16.566992+0000","last_clean":"2024-03-23T23:58:16.566992+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:58:16.566992+0000","last_undegraded":"2024-03-23T23:58:16.566992+0000","last_fullsized":"2024-03-23T23:58:16.566992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596565+0000","last_change":"2024-03-23T23:56:30.887560+0000","last_active":"2024-03-23T23:58:16.596565+0000","last_peered":"2024-03-23T23:58:16.596565+0000","last_clean":"2024-03-23T23:58:16.596565+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:58:16.596565+0000","last_undegraded":"2024-03-23T23:58:16.596565+0000","last_fullsized":"2024-03-23T23:58:16.596565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596103+0000","last_change":"2024-03-23T23:56:29.897890+0000","last_active":"2024-03-23T23:58:16.596103+0000","last_peered":"2024-03-23T23:58:16.596103+0000","last_clean":"2024-03-23T23:58:16.596103+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:58:16.596103+0000","last_undegraded":"2024-03-23T23:58:16.596103+0000","last_fullsized":"2024-03-23T23:58:16.596103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594421+0000","last_change":"2024-03-23T23:56:30.888006+0000","last_active":"2024-03-23T23:58:16.594421+0000","last_peered":"2024-03-23T23:58:16.594421+0000","last_clean":"2024-03-23T23:58:16.594421+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:58:16.594421+0000","last_undegraded":"2024-03-23T23:58:16.594421+0000","last_fullsized":"2024-03-23T23:58:16.594421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566500+0000","last_change":"2024-03-23T23:56:29.888464+0000","last_active":"2024-03-23T23:58:16.566500+0000","last_peered":"2024-03-23T23:58:16.566500+0000","last_clean":"2024-03-23T23:58:16.566500+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:58:16.566500+0000","last_undegraded":"2024-03-23T23:58:16.566500+0000","last_fullsized":"2024-03-23T23:58:16.566500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596781+0000","last_change":"2024-03-23T23:56:30.883536+0000","last_active":"2024-03-23T23:58:16.596781+0000","last_peered":"2024-03-23T23:58:16.596781+0000","last_clean":"2024-03-23T23:58:16.596781+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:58:16.596781+0000","last_undegraded":"2024-03-23T23:58:16.596781+0000","last_fullsized":"2024-03-23T23:58:16.596781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:30:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594838+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:58:16.594838+0000","last_peered":"2024-03-23T23:58:16.594838+0000","last_clean":"2024-03-23T23:58:16.594838+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:58:16.594838+0000","last_undegraded":"2024-03-23T23:58:16.594838+0000","last_fullsized":"2024-03-23T23:58:16.594838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593648+0000","last_change":"2024-03-23T23:56:29.886033+0000","last_active":"2024-03-23T23:58:16.593648+0000","last_peered":"2024-03-23T23:58:16.593648+0000","last_clean":"2024-03-23T23:58:16.593648+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:58:16.593648+0000","last_undegraded":"2024-03-23T23:58:16.593648+0000","last_fullsized":"2024-03-23T23:58:16.593648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577750+0000","last_change":"2024-03-23T23:56:30.883752+0000","last_active":"2024-03-23T23:58:16.577750+0000","last_peered":"2024-03-23T23:58:16.577750+0000","last_clean":"2024-03-23T23:58:16.577750+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:58:16.577750+0000","last_undegraded":"2024-03-23T23:58:16.577750+0000","last_fullsized":"2024-03-23T23:58:16.577750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594644+0000","last_change":"2024-03-23T23:56:29.881565+0000","last_active":"2024-03-23T23:58:16.594644+0000","last_peered":"2024-03-23T23:58:16.594644+0000","last_clean":"2024-03-23T23:58:16.594644+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:58:16.594644+0000","last_undegraded":"2024-03-23T23:58:16.594644+0000","last_fullsized":"2024-03-23T23:58:16.594644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595095+0000","last_change":"2024-03-23T23:56:30.886503+0000","last_active":"2024-03-23T23:58:16.595095+0000","last_peered":"2024-03-23T23:58:16.595095+0000","last_clean":"2024-03-23T23:58:16.595095+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:58:16.595095+0000","last_undegraded":"2024-03-23T23:58:16.595095+0000","last_fullsized":"2024-03-23T23:58:16.595095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:02:03.136599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'8","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:17.065078+0000","last_change":"2024-03-23T23:56:29.886668+0000","last_active":"2024-03-23T23:58:17.065078+0000","last_peered":"2024-03-23T23:58:17.065078+0000","last_clean":"2024-03-23T23:58:17.065078+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:58:17.065078+0000","last_undegraded":"2024-03-23T23:58:17.065078+0000","last_fullsized":"2024-03-23T23:58:17.065078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594097+0000","last_change":"2024-03-23T23:56:30.873826+0000","last_active":"2024-03-23T23:58:16.594097+0000","last_peered":"2024-03-23T23:58:16.594097+0000","last_clean":"2024-03-23T23:58:16.594097+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:58:16.594097+0000","last_undegraded":"2024-03-23T23:58:16.594097+0000","last_fullsized":"2024-03-23T23:58:16.594097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594310+0000","last_change":"2024-03-23T23:56:29.889635+0000","last_active":"2024-03-23T23:58:16.594310+0000","last_peered":"2024-03-23T23:58:16.594310+0000","last_clean":"2024-03-23T23:58:16.594310+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:58:16.594310+0000","last_undegraded":"2024-03-23T23:58:16.594310+0000","last_fullsized":"2024-03-23T23:58:16.594310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.571197+0000","last_change":"2024-03-23T23:56:30.883369+0000","last_active":"2024-03-23T23:58:16.571197+0000","last_peered":"2024-03-23T23:58:16.571197+0000","last_clean":"2024-03-23T23:58:16.571197+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:58:16.571197+0000","last_undegraded":"2024-03-23T23:58:16.571197+0000","last_fullsized":"2024-03-23T23:58:16.571197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:12.049887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594935+0000","last_change":"2024-03-23T23:56:29.883626+0000","last_active":"2024-03-23T23:58:16.594935+0000","last_peered":"2024-03-23T23:58:16.594935+0000","last_clean":"2024-03-23T23:58:16.594935+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:58:16.594935+0000","last_undegraded":"2024-03-23T23:58:16.594935+0000","last_fullsized":"2024-03-23T23:58:16.594935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594655+0000","last_change":"2024-03-23T23:56:30.888942+0000","last_active":"2024-03-23T23:58:16.594655+0000","last_peered":"2024-03-23T23:58:16.594655+0000","last_clean":"2024-03-23T23:58:16.594655+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:58:16.594655+0000","last_undegraded":"2024-03-23T23:58:16.594655+0000","last_fullsized":"2024-03-23T23:58:16.594655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.597034+0000","last_change":"2024-03-23T23:56:29.886058+0000","last_active":"2024-03-23T23:58:16.597034+0000","last_peered":"2024-03-23T23:58:16.597034+0000","last_clean":"2024-03-23T23:58:16.597034+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:58:16.597034+0000","last_undegraded":"2024-03-23T23:58:16.597034+0000","last_fullsized":"2024-03-23T23:58:16.597034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:16.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594642+0000","last_change":"2024-03-23T23:56:30.878188+0000","last_active":"2024-03-23T23:58:16.594642+0000","last_peered":"2024-03-23T23:58:16.594642+0000","last_clean":"2024-03-23T23:58:16.594642+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:58:16.594642+0000","last_undegraded":"2024-03-23T23:58:16.594642+0000","last_fullsized":"2024-03-23T23:58:16.594642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595255+0000","last_change":"2024-03-23T23:56:29.884993+0000","last_active":"2024-03-23T23:58:16.595255+0000","last_peered":"2024-03-23T23:58:16.595255+0000","last_clean":"2024-03-23T23:58:16.595255+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:58:16.595255+0000","last_undegraded":"2024-03-23T23:58:16.595255+0000","last_fullsized":"2024-03-23T23:58:16.595255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'3","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566369+0000","last_change":"2024-03-23T23:57:11.228752+0000","last_active":"2024-03-23T23:58:16.566369+0000","last_peered":"2024-03-23T23:58:16.566369+0000","last_clean":"2024-03-23T23:58:16.566369+0000","last_became_active":"2024-03-23T23:57:11.227669+0000","last_became_peered":"2024-03-23T23:57:11.227669+0000","last_unstale":"2024-03-23T23:58:16.566369+0000","last_undegraded":"2024-03-23T23:58:16.566369+0000","last_fullsized":"2024-03-23T23:58:16.566369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.570023+0000","last_change":"2024-03-23T23:56:29.881331+0000","last_active":"2024-03-23T23:58:16.570023+0000","last_peered":"2024-03-23T23:58:16.570023+0000","last_clean":"2024-03-23T23:58:16.570023+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:58:16.570023+0000","last_undegraded":"2024-03-23T23:58:16.570023+0000","last_fullsized":"2024-03-23T23:58:16.570023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595989+0000","last_change":"2024-03-23T23:56:30.874453+0000","last_active":"2024-03-23T23:58:16.595989+0000","last_peered":"2024-03-23T23:58:16.595989+0000","last_clean":"2024-03-23T23:58:16.595989+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:58:16.595989+0000","last_undegraded":"2024-03-23T23:58:16.595989+0000","last_fullsized":"2024-03-23T23:58:16.595989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594425+0000","last_change":"2024-03-23T23:56:29.879862+0000","last_active":"2024-03-23T23:58:16.594425+0000","last_peered":"2024-03-23T23:58:16.594425+0000","last_clean":"2024-03-23T23:58:16.594425+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:58:16.594425+0000","last_undegraded":"2024-03-23T23:58:16.594425+0000","last_fullsized":"2024-03-23T23:58:16.594425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"23'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569771+0000","last_change":"2024-03-23T23:56:30.874693+0000","last_active":"2024-03-23T23:58:16.569771+0000","last_peered":"2024-03-23T23:58:16.569771+0000","last_clean":"2024-03-23T23:58:16.569771+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:58:16.569771+0000","last_undegraded":"2024-03-23T23:58:16.569771+0000","last_fullsized":"2024-03-23T23:58:16.569771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594558+0000","last_change":"2024-03-23T23:56:29.887900+0000","last_active":"2024-03-23T23:58:16.594558+0000","last_peered":"2024-03-23T23:58:16.594558+0000","last_clean":"2024-03-23T23:58:16.594558+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:58:16.594558+0000","last_undegraded":"2024-03-23T23:58:16.594558+0000","last_fullsized":"2024-03-23T23:58:16.594558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577351+0000","last_change":"2024-03-23T23:56:30.875932+0000","last_active":"2024-03-23T23:58:16.577351+0000","last_peered":"2024-03-23T23:58:16.577351+0000","last_clean":"2024-03-23T23:58:16.577351+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:58:16.577351+0000","last_undegraded":"2024-03-23T23:58:16.577351+0000","last_fullsized":"2024-03-23T23:58:16.577351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594461+0000","last_change":"2024-03-23T23:56:29.884727+0000","last_active":"2024-03-23T23:58:16.594461+0000","last_peered":"2024-03-23T23:58:16.594461+0000","last_clean":"2024-03-23T23:58:16.594461+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:58:16.594461+0000","last_undegraded":"2024-03-23T23:58:16.594461+0000","last_fullsized":"2024-03-23T23:58:16.594461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578130+0000","last_change":"2024-03-23T23:56:30.887213+0000","last_active":"2024-03-23T23:58:16.578130+0000","last_peered":"2024-03-23T23:58:16.578130+0000","last_clean":"2024-03-23T23:58:16.578130+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:58:16.578130+0000","last_undegraded":"2024-03-23T23:58:16.578130+0000","last_fullsized":"2024-03-23T23:58:16.578130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596027+0000","last_change":"2024-03-23T23:56:29.895498+0000","last_active":"2024-03-23T23:58:16.596027+0000","last_peered":"2024-03-23T23:58:16.596027+0000","last_clean":"2024-03-23T23:58:16.596027+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:58:16.596027+0000","last_undegraded":"2024-03-23T23:58:16.596027+0000","last_fullsized":"2024-03-23T23:58:16.596027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568366+0000","last_change":"2024-03-23T23:56:30.884001+0000","last_active":"2024-03-23T23:58:16.568366+0000","last_peered":"2024-03-23T23:58:16.568366+0000","last_clean":"2024-03-23T23:58:16.568366+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:58:16.568366+0000","last_undegraded":"2024-03-23T23:58:16.568366+0000","last_fullsized":"2024-03-23T23:58:16.568366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'1","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594334+0000","last_change":"2024-03-23T23:56:30.889155+0000","last_active":"2024-03-23T23:58:16.594334+0000","last_peered":"2024-03-23T23:58:16.594334+0000","last_clean":"2024-03-23T23:58:16.594334+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:58:16.594334+0000","last_undegraded":"2024-03-23T23:58:16.594334+0000","last_fullsized":"2024-03-23T23:58:16.594334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596405+0000","last_change":"2024-03-23T23:56:29.888617+0000","last_active":"2024-03-23T23:58:16.596405+0000","last_peered":"2024-03-23T23:58:16.596405+0000","last_clean":"2024-03-23T23:58:16.596405+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:58:16.596405+0000","last_undegraded":"2024-03-23T23:58:16.596405+0000","last_fullsized":"2024-03-23T23:58:16.596405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594138+0000","last_change":"2024-03-23T23:56:30.888308+0000","last_active":"2024-03-23T23:58:16.594138+0000","last_peered":"2024-03-23T23:58:16.594138+0000","last_clean":"2024-03-23T23:58:16.594138+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:58:16.594138+0000","last_undegraded":"2024-03-23T23:58:16.594138+0000","last_fullsized":"2024-03-23T23:58:16.594138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596826+0000","last_change":"2024-03-23T23:56:29.879942+0000","last_active":"2024-03-23T23:58:16.596826+0000","last_peered":"2024-03-23T23:58:16.596826+0000","last_clean":"2024-03-23T23:58:16.596826+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:58:16.596826+0000","last_undegraded":"2024-03-23T23:58:16.596826+0000","last_fullsized":"2024-03-23T23:58:16.596826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595895+0000","last_change":"2024-03-23T23:57:11.438439+0000","last_active":"2024-03-23T23:58:16.595895+0000","last_peered":"2024-03-23T23:58:16.595895+0000","last_clean":"2024-03-23T23:58:16.595895+0000","last_became_active":"2024-03-23T23:57:11.437365+0000","last_became_peered":"2024-03-23T23:57:11.437365+0000","last_unstale":"2024-03-23T23:58:16.595895+0000","last_undegraded":"2024-03-23T23:58:16.595895+0000","last_fullsized":"2024-03-23T23:58:16.595895+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:30:27.781133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578142+0000","last_change":"2024-03-23T23:56:29.889380+0000","last_active":"2024-03-23T23:58:16.578142+0000","last_peered":"2024-03-23T23:58:16.578142+0000","last_clean":"2024-03-23T23:58:16.578142+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:58:16.578142+0000","last_undegraded":"2024-03-23T23:58:16.578142+0000","last_fullsized":"2024-03-23T23:58:16.578142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566771+0000","last_change":"2024-03-23T23:57:11.078716+0000","last_active":"2024-03-23T23:58:16.566771+0000","last_peered":"2024-03-23T23:58:16.566771+0000","last_clean":"2024-03-23T23:58:16.566771+0000","last_became_active":"2024-03-23T23:57:11.077960+0000","last_became_peered":"2024-03-23T23:57:11.077960+0000","last_unstale":"2024-03-23T23:58:16.566771+0000","last_undegraded":"2024-03-23T23:58:16.566771+0000","last_fullsized":"2024-03-23T23:58:16.566771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596412+0000","last_change":"2024-03-23T23:56:29.886266+0000","last_active":"2024-03-23T23:58:16.596412+0000","last_peered":"2024-03-23T23:58:16.596412+0000","last_clean":"2024-03-23T23:58:16.596412+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:58:16.596412+0000","last_undegraded":"2024-03-23T23:58:16.596412+0000","last_fullsized":"2024-03-23T23:58:16.596412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68282,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":120,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":204800,"data_stored":136564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":684848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":331776,"data_stored":160675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":93988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":94024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":161382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":94605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":94058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":684904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:24.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:58:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.720+0000 7f0da7400640 1 Processor -- start 2024-03-23T23:58:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.720+0000 7f0da7400640 1 -- start start 2024-03-23T23:58:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.721+0000 7f0da7400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00b5510 0x7f0da0071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.721+0000 7f0da7400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0da00b58f0 0x7f0da0148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.721+0000 7f0da7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0da00727e0 0x7f0da01452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.721+0000 7f0da7400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da006f420 con 0x7f0da00b58f0 2024-03-23T23:58:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.721+0000 7f0da7400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da00b46d0 con 0x7f0da00727e0 2024-03-23T23:58:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.721+0000 7f0da7400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00b49b0 con 0x7f0da00b5510 2024-03-23T23:58:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0da00b58f0 0x7f0da0148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0da00b58f0 0x7f0da0148810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43778/0 (socket says 172.21.15.31:43778) 2024-03-23T23:58:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 -- 172.21.15.31:0/478054437 learned_addr learned my addr 172.21.15.31:0/478054437 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0da4a00640 1 --2- 172.21.15.31:0/478054437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00b5510 0x7f0da0071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0da5400640 1 --2- 172.21.15.31:0/478054437 >> v2:172.21.15.59:3300/0 conn(0x7f0da00727e0 0x7f0da01452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 -- 172.21.15.31:0/478054437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00b5510 msgr2=0x7f0da0071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 --2- 172.21.15.31:0/478054437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00b5510 0x7f0da0071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 -- 172.21.15.31:0/478054437 >> v2:172.21.15.59:3300/0 conn(0x7f0da00727e0 msgr2=0x7f0da01452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 --2- 172.21.15.31:0/478054437 >> v2:172.21.15.59:3300/0 conn(0x7f0da00727e0 0x7f0da01452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0d9fe00640 1 -- 172.21.15.31:0/478054437 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00b2620 con 0x7f0da00b58f0 2024-03-23T23:58:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.722+0000 7f0da5400640 1 --2- 172.21.15.31:0/478054437 >> v2:172.21.15.59:3300/0 conn(0x7f0da00727e0 0x7f0da01452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.723+0000 7f0d9fe00640 1 --2- 172.21.15.31:0/478054437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da0148810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0da006ee00 tx=0x7f0d8c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b27cefbb885c4a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.724+0000 7f0d9f400640 1 -- 172.21.15.31:0/478054437 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c038070 con 0x7f0da00b58f0 2024-03-23T23:58:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.724+0000 7f0d9f400640 1 -- 172.21.15.31:0/478054437 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c031740 con 0x7f0da00b58f0 2024-03-23T23:58:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.724+0000 7f0d9f400640 1 -- 172.21.15.31:0/478054437 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c02f050 con 0x7f0da00b58f0 2024-03-23T23:58:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.724+0000 7f0da7400640 1 -- 172.21.15.31:0/478054437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 msgr2=0x7f0da0148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.724+0000 7f0da7400640 1 --2- 172.21.15.31:0/478054437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da0148810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0da006ee00 tx=0x7f0d8c02b7e0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.725+0000 7f0da7400640 1 -- 172.21.15.31:0/478054437 shutdown_connections 2024-03-23T23:58:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.725+0000 7f0da7400640 1 --2- 172.21.15.31:0/478054437 >> v2:172.21.15.59:3300/0 conn(0x7f0da00727e0 0x7f0da01452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.725+0000 7f0da7400640 1 --2- 172.21.15.31:0/478054437 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da0148810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.725+0000 7f0da7400640 1 --2- 172.21.15.31:0/478054437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00b5510 0x7f0da0071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.725+0000 7f0da7400640 1 -- 172.21.15.31:0/478054437 >> 172.21.15.31:0/478054437 conn(0x7f0da0066fe0 msgr2=0x7f0da00673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.725+0000 7f0da7400640 1 -- 172.21.15.31:0/478054437 shutdown_connections 2024-03-23T23:58:24.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.725+0000 7f0da7400640 1 -- 172.21.15.31:0/478054437 wait complete. 2024-03-23T23:58:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.726+0000 7f0da7400640 1 Processor -- start 2024-03-23T23:58:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.726+0000 7f0da7400640 1 -- start start 2024-03-23T23:58:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.727+0000 7f0da7400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00727e0 0x7f0da0141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.727+0000 7f0da7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da00b5510 0x7f0da01402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.727+0000 7f0da7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da013d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.727+0000 7f0da7400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0148ed0 con 0x7f0da00b58f0 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.727+0000 7f0da7400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da0148d50 con 0x7f0da00b5510 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.727+0000 7f0da7400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da00b4ed0 con 0x7f0da00727e0 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da013d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da013d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43780/0 (socket says 172.21.15.31:43780) 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 -- 172.21.15.31:0/157369810 learned_addr learned my addr 172.21.15.31:0/157369810 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da4a00640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00727e0 0x7f0da0141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0d9fe00640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da00b5510 0x7f0da01402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 -- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00727e0 msgr2=0x7f0da0141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00727e0 0x7f0da0141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 -- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da00b5510 msgr2=0x7f0da01402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da00b5510 0x7f0da01402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 -- 172.21.15.31:0/157369810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da01416c0 con 0x7f0da00b58f0 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.728+0000 7f0da5400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da013d9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800cd50 tx=0x7f0d9800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.729+0000 7f0d9cc00640 1 -- 172.21.15.31:0/157369810 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800f680 con 0x7f0da00b58f0 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.729+0000 7f0d9cc00640 1 -- 172.21.15.31:0/157369810 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9800f840 con 0x7f0da00b58f0 2024-03-23T23:58:24.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.729+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da013fdb0 con 0x7f0da00b58f0 2024-03-23T23:58:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.729+0000 7f0d9cc00640 1 -- 172.21.15.31:0/157369810 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9800fc30 con 0x7f0da00b58f0 2024-03-23T23:58:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.729+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da0145790 con 0x7f0da00b58f0 2024-03-23T23:58:24.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.730+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da0141890 con 0x7f0da00b58f0 2024-03-23T23:58:24.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.731+0000 7f0d9cc00640 1 -- 172.21.15.31:0/157369810 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0d980213f0 con 0x7f0da00b58f0 2024-03-23T23:58:24.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.732+0000 7f0d9cc00640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0d8006bbd0 0x7f0d8006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:24.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.732+0000 7f0d9cc00640 1 -- 172.21.15.31:0/157369810 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0d9808b880 con 0x7f0da00b58f0 2024-03-23T23:58:24.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.733+0000 7f0da4a00640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0d8006bbd0 0x7f0d8006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:24.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.734+0000 7f0da4a00640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0d8006bbd0 0x7f0d8006e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d94006fd0 tx=0x7f0d94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:24.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.737+0000 7f0d9cc00640 1 -- 172.21.15.31:0/157369810 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f0d98014030 con 0x7f0da00b58f0 2024-03-23T23:58:24.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.940+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0da004f400 con 0x7f0da00b58f0 2024-03-23T23:58:24.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.942+0000 7f0d9cc00640 1 -- 172.21.15.31:0/157369810 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16842 (secure 0 0 0) 0x7f0d98059c70 con 0x7f0da00b58f0 2024-03-23T23:58:24.943 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:58:24.943 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:58:16.556971+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/824014188":"2024-03-24T00:58:16.116229+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:58:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.945+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0d8006bbd0 msgr2=0x7f0d8006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.945+0000 7f0da7400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0d8006bbd0 0x7f0d8006e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d94006fd0 tx=0x7f0d94008040 comp rx=0 tx=0).stop 2024-03-23T23:58:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.945+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 msgr2=0x7f0da013d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:24.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.945+0000 7f0da7400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da013d9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800cd50 tx=0x7f0d9800a650 comp rx=0 tx=0).stop 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 shutdown_connections 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0d8006bbd0 0x7f0d8006e090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da00b5510 0x7f0da01402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0da00b58f0 0x7f0da013d9d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 --2- 172.21.15.31:0/157369810 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da00727e0 0x7f0da0141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 >> 172.21.15.31:0/157369810 conn(0x7f0da0066fe0 msgr2=0x7f0da00af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 shutdown_connections 2024-03-23T23:58:24.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:24.946+0000 7f0da7400640 1 -- 172.21.15.31:0/157369810 wait complete. 2024-03-23T23:58:25.968 INFO:tasks.ceph:Scrubbing osd.0 2024-03-23T23:58:25.968 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:26.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.206+0000 7f7b28e00640 1 Processor -- start 2024-03-23T23:58:26.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.206+0000 7f7b28e00640 1 -- start start 2024-03-23T23:58:26.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b28e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b240b5990 0x7f7b241489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b28e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b240b2be0 0x7f7b24148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b28e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240b5d70 con 0x7f7b2413ee20 2024-03-23T23:58:26.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b28e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b24070140 con 0x7f7b240b2be0 2024-03-23T23:58:26.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b28e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2406f3a0 con 0x7f7b240b5990 2024-03-23T23:58:26.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b1be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b240b2be0 0x7f7b24148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b1be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b240b2be0 0x7f7b24148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43786/0 (socket says 172.21.15.31:43786) 2024-03-23T23:58:26.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b1be00640 1 -- 172.21.15.31:0/3947241840 learned_addr learned my addr 172.21.15.31:0/3947241840 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:26.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.208+0000 7f7b21e00640 1 --2- 172.21.15.31:0/3947241840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b240b5990 0x7f7b241489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.209+0000 7f7b1be00640 1 -- 172.21.15.31:0/3947241840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b240b5990 msgr2=0x7f7b241489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.209+0000 7f7b1be00640 1 --2- 172.21.15.31:0/3947241840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b240b5990 0x7f7b241489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.209+0000 7f7b1be00640 1 -- 172.21.15.31:0/3947241840 >> v1:172.21.15.59:6789/0 conn(0x7f7b2413ee20 legacy=0x7f7b2413f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.209+0000 7f7b1be00640 1 -- 172.21.15.31:0/3947241840 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2406f0c0 con 0x7f7b240b2be0 2024-03-23T23:58:26.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.210+0000 7f7b1be00640 1 --2- 172.21.15.31:0/3947241840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b24148f10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009870 tx=0x7f7b0c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82bfbdf9e9ce6cc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.210+0000 7f7b21400640 1 -- 172.21.15.31:0/3947241840 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c038070 con 0x7f7b240b2be0 2024-03-23T23:58:26.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.210+0000 7f7b21400640 1 -- 172.21.15.31:0/3947241840 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c031740 con 0x7f7b240b2be0 2024-03-23T23:58:26.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.210+0000 7f7b21400640 1 -- 172.21.15.31:0/3947241840 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c02f050 con 0x7f7b240b2be0 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 -- 172.21.15.31:0/3947241840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 msgr2=0x7f7b24148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 --2- 172.21.15.31:0/3947241840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b24148f10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009870 tx=0x7f7b0c02b7e0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 -- 172.21.15.31:0/3947241840 shutdown_connections 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 --2- 172.21.15.31:0/3947241840 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b24148f10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 --2- 172.21.15.31:0/3947241840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b240b5990 0x7f7b241489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 -- 172.21.15.31:0/3947241840 >> 172.21.15.31:0/3947241840 conn(0x7f7b24066fb0 msgr2=0x7f7b24067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 -- 172.21.15.31:0/3947241840 shutdown_connections 2024-03-23T23:58:26.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.211+0000 7f7b28e00640 1 -- 172.21.15.31:0/3947241840 wait complete. 2024-03-23T23:58:26.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.213+0000 7f7b28e00640 1 Processor -- start 2024-03-23T23:58:26.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.213+0000 7f7b28e00640 1 -- start start 2024-03-23T23:58:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.214+0000 7f7b28e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b241345a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.214+0000 7f7b28e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b240b5990 0x7f7b24146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b28e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b2413ee20 0x7f7b2412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b28e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2414f9c0 con 0x7f7b240b2be0 2024-03-23T23:58:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b28e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240b2880 con 0x7f7b240b5990 2024-03-23T23:58:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b28e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2414fb40 con 0x7f7b2413ee20 2024-03-23T23:58:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b241345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b241345a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43798/0 (socket says 172.21.15.31:43798) 2024-03-23T23:58:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 -- 172.21.15.31:0/2732661157 learned_addr learned my addr 172.21.15.31:0/2732661157 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b1be00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b240b5990 0x7f7b24146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b22800640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b2413ee20 0x7f7b2412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 -- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b2413ee20 msgr2=0x7f7b2412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b2413ee20 0x7f7b2412ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 -- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b240b5990 msgr2=0x7f7b24146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b240b5990 0x7f7b24146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b21e00640 1 -- 172.21.15.31:0/2732661157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2413a120 con 0x7f7b240b2be0 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.215+0000 7f7b1be00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b240b5990 0x7f7b24146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.216+0000 7f7b21e00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b241345a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400d800 tx=0x7f7b1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.216+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400b660 con 0x7f7b240b2be0 2024-03-23T23:58:26.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.216+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b14019070 con 0x7f7b240b2be0 2024-03-23T23:58:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.216+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400ba20 con 0x7f7b240b2be0 2024-03-23T23:58:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.216+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b241476f0 con 0x7f7b240b2be0 2024-03-23T23:58:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.216+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b241481c0 con 0x7f7b240b2be0 2024-03-23T23:58:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.217+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b2404f400 con 0x7f7b240b2be0 2024-03-23T23:58:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.218+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7b1400bbc0 con 0x7f7b240b2be0 2024-03-23T23:58:26.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.219+0000 7f7b1a000640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7b0006bbd0 0x7f7b0006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.219+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f7b1408afb0 con 0x7f7b240b2be0 2024-03-23T23:58:26.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.220+0000 7f7b1a000640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f7b00073fa0 0x7f7b00076420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.220+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b14001d30 con 0x7f7b00073fa0 2024-03-23T23:58:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.220+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1408d5d0 con 0x7f7b240b2be0 2024-03-23T23:58:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.220+0000 7f7b1be00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7b0006bbd0 0x7f7b0006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.220+0000 7f7b22800640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f7b00073fa0 0x7f7b00076420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.221+0000 7f7b22800640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f7b00073fa0 0x7f7b00076420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.221+0000 7f7b1be00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7b0006bbd0 0x7f7b0006e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c035000 tx=0x7f7b0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.222+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== osd.0 v2:172.21.15.31:6809/2134439972 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7b14001d30 con 0x7f7b00073fa0 2024-03-23T23:58:26.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.237+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 --> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b2406fb80 con 0x7f7b00073fa0 2024-03-23T23:58:26.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.237+0000 7f7b1a000640 1 -- 172.21.15.31:0/2732661157 <== osd.0 v2:172.21.15.31:6809/2134439972 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7b2406fb80 con 0x7f7b00073fa0 2024-03-23T23:58:26.237 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:26.237 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:26.238 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f7b00073fa0 msgr2=0x7f7b00076420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:6809/2134439972,v1:172.21.15.31:6811/2134439972] conn(0x7f7b00073fa0 0x7f7b00076420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7b0006bbd0 msgr2=0x7f7b0006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f7b0006bbd0 0x7f7b0006e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c035000 tx=0x7f7b0c008030 comp rx=0 tx=0).stop 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 msgr2=0x7f7b241345a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 --2- 172.21.15.31:0/2732661157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b240b2be0 0x7f7b241345a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400d800 tx=0x7f7b1400dcc0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b22800640 1 -- 172.21.15.31:0/2732661157 reap_dead start 2024-03-23T23:58:26.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 shutdown_connections 2024-03-23T23:58:26.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 >> 172.21.15.31:0/2732661157 conn(0x7f7b24066fb0 msgr2=0x7f7b240ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 shutdown_connections 2024-03-23T23:58:26.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.238+0000 7f7b28e00640 1 -- 172.21.15.31:0/2732661157 wait complete. 2024-03-23T23:58:26.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-23T23:58:26.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.485+0000 7fdbc0c00640 1 Processor -- start 2024-03-23T23:58:26.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.486+0000 7fdbc0c00640 1 -- start start 2024-03-23T23:58:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.487+0000 7fdbc0c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 0x7fdbbc145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.487+0000 7fdbc0c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0b5e50 con 0x7fdbbc06eeb0 2024-03-23T23:58:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.487+0000 7fdbc0c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc145240 con 0x7fdbbc0b5a70 2024-03-23T23:58:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.487+0000 7fdbc0c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc06f360 con 0x7fdbbc0b27e0 2024-03-23T23:58:26.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbba800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdbbc06eeb0 0x7fdbbc14f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56778/0 (socket says 172.21.15.31:56778) 2024-03-23T23:58:26.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbba800640 1 -- 172.21.15.31:0/3278959894 learned_addr learned my addr 172.21.15.31:0/3278959894 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:26.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb9400640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 0x7fdbbc145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329543129 0 0) 0x7fdbbc0b5e50 con 0x7fdbbc06eeb0 2024-03-23T23:58:26.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb9c003520 con 0x7fdbbc06eeb0 2024-03-23T23:58:26.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2497768802 0 0) 0x7fdb9c003520 con 0x7fdbbc06eeb0 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 msgr2=0x7fdbbc145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 0x7fdbbc145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 >> v1:172.21.15.59:6789/0 conn(0x7fdbbc0b5a70 legacy=0x7fdbbc13f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc145520 con 0x7fdbbc06eeb0 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fdbb4001670 con 0x7fdbbc06eeb0 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.488+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 >> v1:172.21.15.31:6789/0 conn(0x7fdbbc06eeb0 legacy=0x7fdbbc14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb8a00640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c0039e0 0x7fdb9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb8a00640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c004800 0x7fdb9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb8a00640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 0x7fdb9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc06f360 con 0x7fdb9c004800 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c00ba70 con 0x7fdb9c0039e0 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c00bc70 con 0x7fdbbc0b27e0 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb9400640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c004800 0x7fdb9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb9e00640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c0039e0 0x7fdb9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbba800640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 0x7fdb9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb9400640 1 -- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 msgr2=0x7fdb9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb9400640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 0x7fdb9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb9400640 1 -- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c0039e0 msgr2=0x7fdb9c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb9400640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c0039e0 0x7fdb9c003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbb9400640 1 -- 172.21.15.31:0/3278959894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c003520 con 0x7fdb9c004800 2024-03-23T23:58:26.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.489+0000 7fdbba800640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b27e0 0x7fdb9c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:26.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.490+0000 7fdbb9400640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c004800 0x7fdb9c004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc146260 tx=0x7fdb9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5aca10fba5df2c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4039070 con 0x7fdb9c004800 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba402cb90 con 0x7fdb9c004800 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbb8a00640 1 -- 172.21.15.31:0/3278959894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4009c10 con 0x7fdb9c004800 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3278959894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c004800 msgr2=0x7fdb9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbc0c00640 1 --2- 172.21.15.31:0/3278959894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb9c004800 0x7fdb9c004c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc146260 tx=0x7fdb9c005830 comp rx=0 tx=0).stop 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbba800640 1 -- 172.21.15.31:0/3278959894 reap_dead start 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3278959894 shutdown_connections 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.491+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3278959894 >> 172.21.15.31:0/3278959894 conn(0x7fdbbc066fb0 msgr2=0x7fdbbc0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.492+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3278959894 shutdown_connections 2024-03-23T23:58:26.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.492+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3278959894 wait complete. 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.493+0000 7fdbc0c00640 1 Processor -- start 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.493+0000 7fdbc0c00640 1 -- start start 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbc0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c004800 0x7fdbbc0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbc0c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b1df0 0x7fdbbc1e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbc0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc1dcd60 0x7fdbbc137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbc0c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc145d20 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbc0c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc145890 con 0x7fdb9c004800 2024-03-23T23:58:26.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbc0c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc145ea0 con 0x7fdbbc0b1df0 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbba800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc1dcd60 0x7fdbbc137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.494+0000 7fdbba800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc1dcd60 0x7fdbbc137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43812/0 (socket says 172.21.15.31:43812) 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbba800640 1 -- 172.21.15.31:0/3943600673 learned_addr learned my addr 172.21.15.31:0/3943600673 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbb9400640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b1df0 0x7fdbbc1e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbb9e00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c004800 0x7fdbbc0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbba800640 1 -- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b1df0 msgr2=0x7fdbbc1e0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbba800640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b1df0 0x7fdbbc1e0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbba800640 1 -- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c004800 msgr2=0x7fdbbc0b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbba800640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c004800 0x7fdbbc0b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbba800640 1 -- 172.21.15.31:0/3943600673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc1e0470 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.495+0000 7fdbba800640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc1dcd60 0x7fdbbc137810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b6990 tx=0x7fdbb400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.496+0000 7fdbb2000640 1 -- 172.21.15.31:0/3943600673 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40072d0 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.496+0000 7fdbb2000640 1 -- 172.21.15.31:0/3943600673 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4007470 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.496+0000 7fdbb2000640 1 -- 172.21.15.31:0/3943600673 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004a20 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.496+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc1e1170 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.496+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc0b7980 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.497+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc04f400 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.498+0000 7fdbb2000640 1 -- 172.21.15.31:0/3943600673 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fdbb401b020 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.499+0000 7fdbb2000640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdb9806bbd0 0x7fdb9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.499+0000 7fdbb2000640 1 -- 172.21.15.31:0/3943600673 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7fdbb408a620 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.499+0000 7fdbb9e00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdb9806bbd0 0x7fdb9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.501+0000 7fdbb9e00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdb9806bbd0 0x7fdb9806e090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdbac001690 tx=0x7fdbac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.503+0000 7fdbb2000640 1 -- 172.21.15.31:0/3943600673 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fdbb401b310 con 0x7fdbbc1dcd60 2024-03-23T23:58:26.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.711+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbbc06f5f0 con 0x7fdb9806bbd0 2024-03-23T23:58:26.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.712+0000 7fdbb2000640 1 -- 172.21.15.31:0/3943600673 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdbbc06f5f0 con 0x7fdb9806bbd0 2024-03-23T23:58:26.712 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdb9806bbd0 msgr2=0x7fdb9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdb9806bbd0 0x7fdb9806e090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdbac001690 tx=0x7fdbac009040 comp rx=0 tx=0).stop 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc1dcd60 msgr2=0x7fdbbc137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc1dcd60 0x7fdbbc137810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b6990 tx=0x7fdbb400dc00 comp rx=0 tx=0).stop 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 shutdown_connections 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fdb9806bbd0 0x7fdb9806e090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdbbc1dcd60 0x7fdbbc137810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbbc0b1df0 0x7fdbbc1e0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 --2- 172.21.15.31:0/3943600673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb9c004800 0x7fdbbc0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 >> 172.21.15.31:0/3943600673 conn(0x7fdbbc066fb0 msgr2=0x7fdbbc0726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 shutdown_connections 2024-03-23T23:58:26.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.716+0000 7fdbc0c00640 1 -- 172.21.15.31:0/3943600673 wait complete. 2024-03-23T23:58:26.737 INFO:tasks.ceph:Scrubbing osd.1 2024-03-23T23:58:26.738 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.953+0000 7f06a1800640 1 Processor -- start 2024-03-23T23:58:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.953+0000 7f06a1800640 1 -- start start 2024-03-23T23:58:26.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.954+0000 7f06a1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f069c0b22f0 0x7f069c148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.954+0000 7f06a1800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c13f860 con 0x7f069c0b3370 2024-03-23T23:58:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.954+0000 7f06a1800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0b26d0 con 0x7f069c0b40c0 2024-03-23T23:58:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.954+0000 7f06a1800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c149510 con 0x7f069c0b22f0 2024-03-23T23:58:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.955+0000 7f0692000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f069c0b3370 0x7f069c0b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56792/0 (socket says 172.21.15.31:56792) 2024-03-23T23:58:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.955+0000 7f0692000640 1 -- 172.21.15.31:0/1884530655 learned_addr learned my addr 172.21.15.31:0/1884530655 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.955+0000 7f069aa00640 1 --2- 172.21.15.31:0/1884530655 >> v2:172.21.15.59:3300/0 conn(0x7f069c0b22f0 0x7f069c148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.955+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386142144 0 0) 0x7f069c13f860 con 0x7f069c0b3370 2024-03-23T23:58:26.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.955+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0680003520 con 0x7f069c0b3370 2024-03-23T23:58:26.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1447485111 0 0) 0x7f0680003520 con 0x7f069c0b3370 2024-03-23T23:58:26.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 >> v2:172.21.15.59:3300/0 conn(0x7f069c0b22f0 msgr2=0x7f069c148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 --2- 172.21.15.31:0/1884530655 >> v2:172.21.15.59:3300/0 conn(0x7f069c0b22f0 0x7f069c148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 >> v1:172.21.15.59:6789/0 conn(0x7f069c0b40c0 legacy=0x7f069c14f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c1487d0 con 0x7f069c0b3370 2024-03-23T23:58:26.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f0684001670 con 0x7f069c0b3370 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 >> v1:172.21.15.31:6789/0 conn(0x7f069c0b3370 legacy=0x7f069c0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680003a00 0x7f0680003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0680004800 0x7f0680004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06800052e0 0x7f068000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c149510 con 0x7f0680004800 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068000c1e0 con 0x7f0680003a00 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068000c3e0 con 0x7f06800052e0 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f069aa00640 1 --2- 172.21.15.31:0/1884530655 >> v2:172.21.15.59:3300/0 conn(0x7f069c0b22f0 0x7f069c148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:26.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.956+0000 7f0692000640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0680004800 0x7f0680004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f069b400640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06800052e0 0x7f068000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f069aa00640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680003a00 0x7f0680003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f0692000640 1 -- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06800052e0 msgr2=0x7f068000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f0692000640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06800052e0 0x7f068000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f0692000640 1 -- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680003a00 msgr2=0x7f0680003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f0692000640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680003a00 0x7f0680003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f0692000640 1 -- 172.21.15.31:0/1884530655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680003520 con 0x7f0680004800 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f069b400640 1 -- 172.21.15.31:0/1884530655 reap_dead start 2024-03-23T23:58:26.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.957+0000 7f069aa00640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680003a00 0x7f0680003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:26.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.958+0000 7f0692000640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0680004800 0x7f0680004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f068400c0e0 tx=0x7f0680005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0efe3efc6fe2400 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684007c40 con 0x7f0680004800 2024-03-23T23:58:26.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684030070 con 0x7f0680004800 2024-03-23T23:58:26.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f069a000640 1 -- 172.21.15.31:0/1884530655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684005d70 con 0x7f0680004800 2024-03-23T23:58:26.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f06a1800640 1 -- 172.21.15.31:0/1884530655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0680004800 msgr2=0x7f0680004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f06a1800640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0680004800 0x7f0680004c80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f068400c0e0 tx=0x7f0680005830 comp rx=0 tx=0).stop 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f06a1800640 1 -- 172.21.15.31:0/1884530655 shutdown_connections 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f06a1800640 1 --2- 172.21.15.31:0/1884530655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0680004800 0x7f0680004c80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f06a1800640 1 -- 172.21.15.31:0/1884530655 >> 172.21.15.31:0/1884530655 conn(0x7f069c0b8970 msgr2=0x7f069c0b8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.959+0000 7f06a1800640 1 -- 172.21.15.31:0/1884530655 shutdown_connections 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.960+0000 7f06a1800640 1 -- 172.21.15.31:0/1884530655 wait complete. 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.961+0000 7f06a1800640 1 Processor -- start 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.961+0000 7f06a1800640 1 -- start start 2024-03-23T23:58:26.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f06a1800640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0680004800 0x7f069c147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f06a1800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c1cfc70 0x7f069c1d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f06a1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f069c13aad0 0x7f069c13af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f06a1800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0736a0 con 0x7f069c1cfc70 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f06a1800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c073520 con 0x7f069c13aad0 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f06a1800640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0b49f0 con 0x7f0680004800 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f0692000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c1cfc70 0x7f069c1d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f0692000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c1cfc70 0x7f069c1d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43834/0 (socket says 172.21.15.31:43834) 2024-03-23T23:58:26.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.962+0000 7f0692000640 1 -- 172.21.15.31:0/4203149714 learned_addr learned my addr 172.21.15.31:0/4203149714 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f069aa00640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0680004800 0x7f069c147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f069b400640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f069c13aad0 0x7f069c13af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f0692000640 1 -- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0680004800 msgr2=0x7f069c147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f0692000640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0680004800 0x7f069c147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f0692000640 1 -- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f069c13aad0 msgr2=0x7f069c13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f0692000640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f069c13aad0 0x7f069c13af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f0692000640 1 -- 172.21.15.31:0/4203149714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c1cf3e0 con 0x7f069c1cfc70 2024-03-23T23:58:26.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f069b400640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f069c13aad0 0x7f069c13af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:26.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.963+0000 7f0692000640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c1cfc70 0x7f069c1d00f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f068402c480 tx=0x7f068402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.964+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840049e0 con 0x7f069c1cfc70 2024-03-23T23:58:26.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.964+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684004b80 con 0x7f069c1cfc70 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.964+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684007070 con 0x7f069c1cfc70 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.964+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c0b1ba0 con 0x7f069c1cfc70 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.964+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c0aecd0 con 0x7f069c1cfc70 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.965+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f069c1ceeb0 con 0x7f069c1cfc70 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.966+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0684048020 con 0x7f069c1cfc70 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.967+0000 7f0693400640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f067806bc00 0x7f067806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.967+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f06840abd60 con 0x7f069c1cfc70 2024-03-23T23:58:26.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.967+0000 7f0693400640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7f0678073fe0 0x7f0678076460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:26.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.967+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 --> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f068404bec0 con 0x7f0678073fe0 2024-03-23T23:58:26.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.967+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06840ae460 con 0x7f069c1cfc70 2024-03-23T23:58:26.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.967+0000 7f069b400640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7f0678073fe0 0x7f0678076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.967+0000 7f069aa00640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f067806bc00 0x7f067806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:26.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.968+0000 7f069b400640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7f0678073fe0 0x7f0678076460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.968+0000 7f069aa00640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f067806bc00 0x7f067806e0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f069c073b40 tx=0x7f068c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:26.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.969+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== osd.1 v2:172.21.15.31:6800/2615987950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f068404bec0 con 0x7f0678073fe0 2024-03-23T23:58:26.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.983+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 --> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f069c04f400 con 0x7f0678073fe0 2024-03-23T23:58:26.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.984+0000 7f0693400640 1 -- 172.21.15.31:0/4203149714 <== osd.1 v2:172.21.15.31:6800/2615987950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f069c04f400 con 0x7f0678073fe0 2024-03-23T23:58:26.984 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:26.984 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:26.984 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.984+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7f0678073fe0 msgr2=0x7f0678076460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.984+0000 7f06a1800640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:6800/2615987950,v1:172.21.15.31:6801/2615987950] conn(0x7f0678073fe0 0x7f0678076460 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.984+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f067806bc00 msgr2=0x7f067806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.984+0000 7f06a1800640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f067806bc00 0x7f067806e0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f069c073b40 tx=0x7f068c00b040 comp rx=0 tx=0).stop 2024-03-23T23:58:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.984+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c1cfc70 msgr2=0x7f069c1d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.984+0000 7f06a1800640 1 --2- 172.21.15.31:0/4203149714 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f069c1cfc70 0x7f069c1d00f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f068402c480 tx=0x7f068402e070 comp rx=0 tx=0).stop 2024-03-23T23:58:26.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.985+0000 7f069b400640 1 -- 172.21.15.31:0/4203149714 reap_dead start 2024-03-23T23:58:26.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.985+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 shutdown_connections 2024-03-23T23:58:26.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.985+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 >> 172.21.15.31:0/4203149714 conn(0x7f069c0b8970 msgr2=0x7f069c071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:26.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.985+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 shutdown_connections 2024-03-23T23:58:26.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:26.985+0000 7f06a1800640 1 -- 172.21.15.31:0/4203149714 wait complete. 2024-03-23T23:58:27.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-23T23:58:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.228+0000 7f3f6d600640 1 Processor -- start 2024-03-23T23:58:27.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.228+0000 7f3f6d600640 1 -- start start 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.229+0000 7f3f6d600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f680b7530 0x7f3f68144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f6d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f680b79e0 0x7f3f68144850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f6d600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f680b6e10 con 0x7f3f680b6a30 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f6d600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680b3480 con 0x7f3f680b7530 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f6d600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680b36d0 con 0x7f3f680b79e0 2024-03-23T23:58:27.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f5f400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f680b7530 0x7f3f68144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f5f400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3f680b7530 0x7f3f68144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43842/0 (socket says 172.21.15.31:43842) 2024-03-23T23:58:27.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f5f400640 1 -- 172.21.15.31:0/1858652216 learned_addr learned my addr 172.21.15.31:0/1858652216 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:27.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.230+0000 7f3f6cc00640 1 --2- 172.21.15.31:0/1858652216 >> v2:172.21.15.59:3300/0 conn(0x7f3f680b79e0 0x7f3f68144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.231+0000 7f3f5f400640 1 -- 172.21.15.31:0/1858652216 >> v2:172.21.15.59:3300/0 conn(0x7f3f680b79e0 msgr2=0x7f3f68144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.231+0000 7f3f5f400640 1 --2- 172.21.15.31:0/1858652216 >> v2:172.21.15.59:3300/0 conn(0x7f3f680b79e0 0x7f3f68144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.231+0000 7f3f5f400640 1 -- 172.21.15.31:0/1858652216 >> v1:172.21.15.59:6789/0 conn(0x7f3f680b6a30 legacy=0x7f3f680b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.231+0000 7f3f5f400640 1 -- 172.21.15.31:0/1858652216 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f680b3d20 con 0x7f3f680b7530 2024-03-23T23:58:27.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.232+0000 7f3f5f400640 1 --2- 172.21.15.31:0/1858652216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f68144310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f680b3600 tx=0x7f3f5002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18026d47ae9fc918 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.232+0000 7f3f67400640 1 -- 172.21.15.31:0/1858652216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50035020 con 0x7f3f680b7530 2024-03-23T23:58:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.233+0000 7f3f67400640 1 -- 172.21.15.31:0/1858652216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50031870 con 0x7f3f680b7530 2024-03-23T23:58:27.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.233+0000 7f3f67400640 1 -- 172.21.15.31:0/1858652216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50031c40 con 0x7f3f680b7530 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.233+0000 7f3f6d600640 1 -- 172.21.15.31:0/1858652216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 msgr2=0x7f3f68144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.233+0000 7f3f6d600640 1 --2- 172.21.15.31:0/1858652216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f68144310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f680b3600 tx=0x7f3f5002b910 comp rx=0 tx=0).stop 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.234+0000 7f3f6d600640 1 -- 172.21.15.31:0/1858652216 shutdown_connections 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.234+0000 7f3f6d600640 1 --2- 172.21.15.31:0/1858652216 >> v2:172.21.15.59:3300/0 conn(0x7f3f680b79e0 0x7f3f68144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.234+0000 7f3f6d600640 1 --2- 172.21.15.31:0/1858652216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f68144310 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.234+0000 7f3f6d600640 1 -- 172.21.15.31:0/1858652216 >> 172.21.15.31:0/1858652216 conn(0x7f3f6806cf40 msgr2=0x7f3f6806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.234+0000 7f3f6d600640 1 -- 172.21.15.31:0/1858652216 shutdown_connections 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.234+0000 7f3f6d600640 1 -- 172.21.15.31:0/1858652216 wait complete. 2024-03-23T23:58:27.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.236+0000 7f3f6d600640 1 Processor -- start 2024-03-23T23:58:27.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.236+0000 7f3f6d600640 1 -- start start 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f6d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f680b6a30 0x7f3f6809ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f6d600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f681e0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f6d600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f680b79e0 0x7f3f681e05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f6d600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680b4800 con 0x7f3f680b7530 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f6d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680b42e0 con 0x7f3f680b6a30 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f6d600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680b4980 con 0x7f3f680b79e0 2024-03-23T23:58:27.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f681e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f681e0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43854/0 (socket says 172.21.15.31:43854) 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.237+0000 7f3f5f400640 1 -- 172.21.15.31:0/17140901 learned_addr learned my addr 172.21.15.31:0/17140901 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f67e00640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f680b6a30 0x7f3f6809ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f5f400640 1 -- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f680b79e0 msgr2=0x7f3f681e05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f5f400640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f680b79e0 0x7f3f681e05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f5f400640 1 -- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f680b6a30 msgr2=0x7f3f6809ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f5f400640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f680b6a30 0x7f3f6809ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f5f400640 1 -- 172.21.15.31:0/17140901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f68145310 con 0x7f3f680b7530 2024-03-23T23:58:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f67e00640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f680b6a30 0x7f3f6809ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:27.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f5f400640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f681e0060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f5002b950 tx=0x7f3f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f64c00640 1 -- 172.21.15.31:0/17140901 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50040070 con 0x7f3f680b7530 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f64c00640 1 -- 172.21.15.31:0/17140901 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50030d00 con 0x7f3f680b7530 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f64c00640 1 -- 172.21.15.31:0/17140901 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50035040 con 0x7f3f680b7530 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.238+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6809d490 con 0x7f3f680b7530 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.239+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f680b1810 con 0x7f3f680b7530 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.240+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6814b590 con 0x7f3f680b7530 2024-03-23T23:58:27.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.241+0000 7f3f64c00640 1 -- 172.21.15.31:0/17140901 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3f50038020 con 0x7f3f680b7530 2024-03-23T23:58:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.242+0000 7f3f64c00640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3f4406bbd0 0x7f3f4406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.242+0000 7f3f64c00640 1 -- 172.21.15.31:0/17140901 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f3f500ac8d0 con 0x7f3f680b7530 2024-03-23T23:58:27.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.242+0000 7f3f67e00640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3f4406bbd0 0x7f3f4406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.244+0000 7f3f67e00640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3f4406bbd0 0x7f3f4406e090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f68068350 tx=0x7f3f58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.246+0000 7f3f64c00640 1 -- 172.21.15.31:0/17140901 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f3f6814b590 con 0x7f3f680b7530 2024-03-23T23:58:27.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.449+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f680752c0 con 0x7f3f4406bbd0 2024-03-23T23:58:27.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.450+0000 7f3f64c00640 1 -- 172.21.15.31:0/17140901 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3f680752c0 con 0x7f3f4406bbd0 2024-03-23T23:58:27.450 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-03-23T23:58:27.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3f4406bbd0 msgr2=0x7f3f4406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3f4406bbd0 0x7f3f4406e090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f68068350 tx=0x7f3f58009040 comp rx=0 tx=0).stop 2024-03-23T23:58:27.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 msgr2=0x7f3f681e0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f681e0060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3f5002b950 tx=0x7f3f500046c0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 shutdown_connections 2024-03-23T23:58:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3f4406bbd0 0x7f3f4406e090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f680b79e0 0x7f3f681e05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3f680b7530 0x7f3f681e0060 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 --2- 172.21.15.31:0/17140901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f680b6a30 0x7f3f6809ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 >> 172.21.15.31:0/17140901 conn(0x7f3f6806cf40 msgr2=0x7f3f6813ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 shutdown_connections 2024-03-23T23:58:27.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.453+0000 7f3f6d600640 1 -- 172.21.15.31:0/17140901 wait complete. 2024-03-23T23:58:27.473 INFO:tasks.ceph:Scrubbing osd.2 2024-03-23T23:58:27.473 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:27.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.700+0000 7fd71ae00640 1 Processor -- start 2024-03-23T23:58:27.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.700+0000 7fd71ae00640 1 -- start start 2024-03-23T23:58:27.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.702+0000 7fd71ae00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 0x7fd71413ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.702+0000 7fd71ae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7140b2be0 0x7fd71413f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.702+0000 7fd71ae00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140b5d70 con 0x7fd7140b5990 2024-03-23T23:58:27.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.702+0000 7fd71ae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71413f8a0 con 0x7fd7140b2be0 2024-03-23T23:58:27.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.702+0000 7fd71ae00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd714070140 con 0x7fd7141490e0 2024-03-23T23:58:27.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.702+0000 7fd713e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd7140b5990 0x7fd7141489d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56800/0 (socket says 172.21.15.31:56800) 2024-03-23T23:58:27.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.702+0000 7fd713e00640 1 -- 172.21.15.31:0/4027390557 learned_addr learned my addr 172.21.15.31:0/4027390557 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:27.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd718e00640 1 --2- 172.21.15.31:0/4027390557 >> v2:172.21.15.59:3300/0 conn(0x7fd7140b2be0 0x7fd71413f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd70be00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 0x7fd71413ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654827620 0 0) 0x7fd7140b5d70 con 0x7fd7140b5990 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f8003520 con 0x7fd7140b5990 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1236622767 0 0) 0x7fd6f8003520 con 0x7fd7140b5990 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 msgr2=0x7fd71413ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 0x7fd71413ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 >> v2:172.21.15.59:3300/0 conn(0x7fd7140b2be0 msgr2=0x7fd71413f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 --2- 172.21.15.31:0/4027390557 >> v2:172.21.15.59:3300/0 conn(0x7fd7140b2be0 0x7fd71413f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71406f3a0 con 0x7fd7140b5990 2024-03-23T23:58:27.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fd704001670 con 0x7fd7140b5990 2024-03-23T23:58:27.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 >> v1:172.21.15.31:6789/0 conn(0x7fd7140b5990 legacy=0x7fd7141489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 0x7fd6f80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8003f60 0x7fd6f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f8004d40 0x7fd6f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714070140 con 0x7fd6f8004d40 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f800b9c0 con 0x7fd6f8003f60 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.703+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f800bbc0 con 0x7fd7141490e0 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd718e00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f8004d40 0x7fd6f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd70be00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8003f60 0x7fd6f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd713e00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 0x7fd6f80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd718e00640 1 -- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 msgr2=0x7fd6f80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd718e00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7141490e0 0x7fd6f80039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd718e00640 1 -- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8003f60 msgr2=0x7fd6f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd718e00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8003f60 0x7fd6f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd718e00640 1 -- 172.21.15.31:0/4027390557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8003520 con 0x7fd6f8004d40 2024-03-23T23:58:27.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.704+0000 7fd70be00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8003f60 0x7fd6f8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:27.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.705+0000 7fd718e00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f8004d40 0x7fd6f80051c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009fc0 tx=0x7fd6f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a176362e2d9692 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.705+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c039070 con 0x7fd6f8004d40 2024-03-23T23:58:27.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.705+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c02cc60 con 0x7fd6f8004d40 2024-03-23T23:58:27.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.705+0000 7fd713400640 1 -- 172.21.15.31:0/4027390557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c009c10 con 0x7fd6f8004d40 2024-03-23T23:58:27.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.706+0000 7fd71ae00640 1 -- 172.21.15.31:0/4027390557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f8004d40 msgr2=0x7fd6f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.706+0000 7fd71ae00640 1 --2- 172.21.15.31:0/4027390557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd6f8004d40 0x7fd6f80051c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009fc0 tx=0x7fd6f8005830 comp rx=0 tx=0).stop 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.706+0000 7fd718e00640 1 -- 172.21.15.31:0/4027390557 reap_dead start 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.706+0000 7fd71ae00640 1 -- 172.21.15.31:0/4027390557 shutdown_connections 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.706+0000 7fd71ae00640 1 -- 172.21.15.31:0/4027390557 >> 172.21.15.31:0/4027390557 conn(0x7fd714066fb0 msgr2=0x7fd714067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.706+0000 7fd71ae00640 1 -- 172.21.15.31:0/4027390557 shutdown_connections 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.706+0000 7fd71ae00640 1 -- 172.21.15.31:0/4027390557 wait complete. 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.708+0000 7fd71ae00640 1 Processor -- start 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.708+0000 7fd71ae00640 1 -- start start 2024-03-23T23:58:27.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd71ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8004d40 0x7fd71413fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd71ae00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd714142f30 0x7fd7141433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd71ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7140b8ac0 0x7fd7140b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd71ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140b27f0 con 0x7fd7140b8ac0 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd71ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140b2670 con 0x7fd6f8004d40 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd71ae00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71413ee20 con 0x7fd714142f30 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd718e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7140b8ac0 0x7fd7140b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd718e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7140b8ac0 0x7fd7140b8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43880/0 (socket says 172.21.15.31:43880) 2024-03-23T23:58:27.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd718e00640 1 -- 172.21.15.31:0/248164910 learned_addr learned my addr 172.21.15.31:0/248164910 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd713e00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8004d40 0x7fd71413fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd70be00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd714142f30 0x7fd7141433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd718e00640 1 -- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd714142f30 msgr2=0x7fd7141433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.709+0000 7fd718e00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd714142f30 0x7fd7141433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd718e00640 1 -- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8004d40 msgr2=0x7fd71413fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd718e00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f8004d40 0x7fd71413fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd718e00640 1 -- 172.21.15.31:0/248164910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7141409c0 con 0x7fd7140b8ac0 2024-03-23T23:58:27.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd718e00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7140b8ac0 0x7fd7140b8f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd70c037040 tx=0x7fd70c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c039030 con 0x7fd7140b8ac0 2024-03-23T23:58:27.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c03a040 con 0x7fd7140b8ac0 2024-03-23T23:58:27.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c009c10 con 0x7fd7140b8ac0 2024-03-23T23:58:27.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd714141ee0 con 0x7fd7140b8ac0 2024-03-23T23:58:27.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.710+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd714145dc0 con 0x7fd7140b8ac0 2024-03-23T23:58:27.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.711+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7141407d0 con 0x7fd7140b8ac0 2024-03-23T23:58:27.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.712+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd70c045030 con 0x7fd7140b8ac0 2024-03-23T23:58:27.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.713+0000 7fd710c00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd6f006bbd0 0x7fd6f006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.714+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7fd70c0ac810 con 0x7fd7140b8ac0 2024-03-23T23:58:27.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.714+0000 7fd710c00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7fd6f0073fb0 0x7fd6f0076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.714+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 --> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd70c0091a0 con 0x7fd6f0073fb0 2024-03-23T23:58:27.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.714+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd70c0b3050 con 0x7fd7140b8ac0 2024-03-23T23:58:27.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.714+0000 7fd713e00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd6f006bbd0 0x7fd6f006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.714+0000 7fd70be00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7fd6f0073fb0 0x7fd6f0076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.715+0000 7fd70be00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7fd6f0073fb0 0x7fd6f0076430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.715+0000 7fd713e00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd6f006bbd0 0x7fd6f006e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd704000f60 tx=0x7fd704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.715+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== osd.2 v2:172.21.15.31:6808/636958187 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd70c0091a0 con 0x7fd6f0073fb0 2024-03-23T23:58:27.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.731+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 --> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd71404f400 con 0x7fd6f0073fb0 2024-03-23T23:58:27.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.731+0000 7fd710c00640 1 -- 172.21.15.31:0/248164910 <== osd.2 v2:172.21.15.31:6808/636958187 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd71404f400 con 0x7fd6f0073fb0 2024-03-23T23:58:27.731 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:27.731 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:27.731 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:27.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.731+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7fd6f0073fb0 msgr2=0x7fd6f0076430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:6808/636958187,v1:172.21.15.31:6810/636958187] conn(0x7fd6f0073fb0 0x7fd6f0076430 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd6f006bbd0 msgr2=0x7fd6f006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd6f006bbd0 0x7fd6f006e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd704000f60 tx=0x7fd704009040 comp rx=0 tx=0).stop 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7140b8ac0 msgr2=0x7fd7140b8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 --2- 172.21.15.31:0/248164910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd7140b8ac0 0x7fd7140b8f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd70c037040 tx=0x7fd70c009750 comp rx=0 tx=0).stop 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd718e00640 1 -- 172.21.15.31:0/248164910 reap_dead start 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 shutdown_connections 2024-03-23T23:58:27.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 >> 172.21.15.31:0/248164910 conn(0x7fd714066fb0 msgr2=0x7fd7141468c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 shutdown_connections 2024-03-23T23:58:27.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.732+0000 7fd71ae00640 1 -- 172.21.15.31:0/248164910 wait complete. 2024-03-23T23:58:27.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-23T23:58:27.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.968+0000 7f3c66a00640 1 Processor -- start 2024-03-23T23:58:27.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.968+0000 7f3c66a00640 1 -- start start 2024-03-23T23:58:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.969+0000 7f3c66a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c60142380 0x7f3c601427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.969+0000 7f3c66a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c60148950 0x7f3c60148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c66a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c600b8c90 con 0x7f3c600b88b0 2024-03-23T23:58:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c66a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c600b4f60 con 0x7f3c60142380 2024-03-23T23:58:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c66a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600b49a0 con 0x7f3c60148950 2024-03-23T23:58:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c65600640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3c600b88b0 0x7f3c600b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56816/0 (socket says 172.21.15.31:56816) 2024-03-23T23:58:27.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c65600640 1 -- 172.21.15.31:0/3520633926 learned_addr learned my addr 172.21.15.31:0/3520633926 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:27.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c64c00640 1 --2- 172.21.15.31:0/3520633926 >> v2:172.21.15.31:3300/0 conn(0x7f3c60142380 0x7f3c601427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c66000640 1 --2- 172.21.15.31:0/3520633926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c60148950 0x7f3c60148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c5fe00640 1 -- 172.21.15.31:0/3520633926 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680207015 0 0) 0x7f3c600b8c90 con 0x7f3c600b88b0 2024-03-23T23:58:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c64c00640 1 -- 172.21.15.31:0/3520633926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c60148950 msgr2=0x7f3c60148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c64c00640 1 --2- 172.21.15.31:0/3520633926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c60148950 0x7f3c60148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c64c00640 1 -- 172.21.15.31:0/3520633926 >> v1:172.21.15.31:6789/0 conn(0x7f3c600b88b0 legacy=0x7f3c600b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.970+0000 7f3c64c00640 1 -- 172.21.15.31:0/3520633926 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c600b4c80 con 0x7f3c60142380 2024-03-23T23:58:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.972+0000 7f3c64c00640 1 --2- 172.21.15.31:0/3520633926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60142380 0x7f3c601427f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0097a0 tx=0x7f3c4c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26a2d0f27c31ba8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.972+0000 7f3c5fe00640 1 -- 172.21.15.31:0/3520633926 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c038070 con 0x7f3c60142380 2024-03-23T23:58:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.972+0000 7f3c5fe00640 1 -- 172.21.15.31:0/3520633926 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c031700 con 0x7f3c60142380 2024-03-23T23:58:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.972+0000 7f3c5fe00640 1 -- 172.21.15.31:0/3520633926 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c031ad0 con 0x7f3c60142380 2024-03-23T23:58:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.972+0000 7f3c66a00640 1 -- 172.21.15.31:0/3520633926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60142380 msgr2=0x7f3c601427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.972+0000 7f3c66a00640 1 --2- 172.21.15.31:0/3520633926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60142380 0x7f3c601427f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0097a0 tx=0x7f3c4c02b7a0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.973+0000 7f3c66a00640 1 -- 172.21.15.31:0/3520633926 shutdown_connections 2024-03-23T23:58:27.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.973+0000 7f3c66a00640 1 --2- 172.21.15.31:0/3520633926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c60148950 0x7f3c60148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.973+0000 7f3c66a00640 1 --2- 172.21.15.31:0/3520633926 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60142380 0x7f3c601427f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.973+0000 7f3c66a00640 1 -- 172.21.15.31:0/3520633926 >> 172.21.15.31:0/3520633926 conn(0x7f3c6006cf40 msgr2=0x7f3c6006ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.973+0000 7f3c66a00640 1 -- 172.21.15.31:0/3520633926 shutdown_connections 2024-03-23T23:58:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.973+0000 7f3c66a00640 1 -- 172.21.15.31:0/3520633926 wait complete. 2024-03-23T23:58:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.974+0000 7f3c66a00640 1 Processor -- start 2024-03-23T23:58:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.974+0000 7f3c66a00640 1 -- start start 2024-03-23T23:58:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c600b88b0 0x7f3c60142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c60142380 0x7f3c600b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60148950 0x7f3c600b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c600b9490 con 0x7f3c60148950 2024-03-23T23:58:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c601492a0 con 0x7f3c60142380 2024-03-23T23:58:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60144590 con 0x7f3c600b88b0 2024-03-23T23:58:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60148950 0x7f3c600b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60148950 0x7f3c600b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43898/0 (socket says 172.21.15.31:43898) 2024-03-23T23:58:27.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.975+0000 7f3c66000640 1 -- 172.21.15.31:0/2021108941 learned_addr learned my addr 172.21.15.31:0/2021108941 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c64c00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c60142380 0x7f3c600b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c66000640 1 -- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c600b88b0 msgr2=0x7f3c60142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c66000640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c600b88b0 0x7f3c60142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c66000640 1 -- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c60142380 msgr2=0x7f3c600b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c66000640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c60142380 0x7f3c600b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c66000640 1 -- 172.21.15.31:0/2021108941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60145c60 con 0x7f3c60148950 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c64c00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c60142380 0x7f3c600b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c66000640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60148950 0x7f3c600b1450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c58007e60 tx=0x7f3c5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c5d600640 1 -- 172.21.15.31:0/2021108941 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58014420 con 0x7f3c60148950 2024-03-23T23:58:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c5d600640 1 -- 172.21.15.31:0/2021108941 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c58019070 con 0x7f3c60148950 2024-03-23T23:58:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c5d600640 1 -- 172.21.15.31:0/2021108941 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c58014820 con 0x7f3c60148950 2024-03-23T23:58:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.976+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c601442b0 con 0x7f3c60148950 2024-03-23T23:58:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.977+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c60143fd0 con 0x7f3c60148950 2024-03-23T23:58:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.978+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c600752c0 con 0x7f3c60148950 2024-03-23T23:58:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.979+0000 7f3c5d600640 1 -- 172.21.15.31:0/2021108941 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3c580149c0 con 0x7f3c60148950 2024-03-23T23:58:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.980+0000 7f3c5d600640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c4006bbd0 0x7f3c4006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.980+0000 7f3c5d600640 1 -- 172.21.15.31:0/2021108941 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f3c5808b2f0 con 0x7f3c60148950 2024-03-23T23:58:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.980+0000 7f3c65600640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c4006bbd0 0x7f3c4006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.981+0000 7f3c65600640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c4006bbd0 0x7f3c4006e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c54005880 tx=0x7f3c54007950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:27.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:27.984+0000 7f3c5d600640 1 -- 172.21.15.31:0/2021108941 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f3c58059d30 con 0x7f3c60148950 2024-03-23T23:58:28.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.189+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c601403f0 con 0x7f3c4006bbd0 2024-03-23T23:58:28.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.190+0000 7f3c5d600640 1 -- 172.21.15.31:0/2021108941 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c601403f0 con 0x7f3c4006bbd0 2024-03-23T23:58:28.190 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-03-23T23:58:28.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.194+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c4006bbd0 msgr2=0x7f3c4006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.194+0000 7f3c66a00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c4006bbd0 0x7f3c4006e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3c54005880 tx=0x7f3c54007950 comp rx=0 tx=0).stop 2024-03-23T23:58:28.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.194+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60148950 msgr2=0x7f3c600b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.194+0000 7f3c66a00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60148950 0x7f3c600b1450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c58007e60 tx=0x7f3c5800e4b0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 shutdown_connections 2024-03-23T23:58:28.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c4006bbd0 0x7f3c4006e090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c60142380 0x7f3c600b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c60148950 0x7f3c600b1450 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 --2- 172.21.15.31:0/2021108941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c600b88b0 0x7f3c60142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 >> 172.21.15.31:0/2021108941 conn(0x7f3c6006cf40 msgr2=0x7f3c600b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 shutdown_connections 2024-03-23T23:58:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.195+0000 7f3c66a00640 1 -- 172.21.15.31:0/2021108941 wait complete. 2024-03-23T23:58:28.213 INFO:tasks.ceph:Scrubbing osd.3 2024-03-23T23:58:28.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:28.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.438+0000 7f2d1e000640 1 Processor -- start 2024-03-23T23:58:28.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.438+0000 7f2d1e000640 1 -- start start 2024-03-23T23:58:28.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.439+0000 7f2d1e000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d180b4bf0 0x7f2d180b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.439+0000 7f2d1e000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b89d0 0x7f2d18151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d1e000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180af080 con 0x7f2d181413d0 2024-03-23T23:58:28.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d1e000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180ad600 con 0x7f2d180b4bf0 2024-03-23T23:58:28.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d1e000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180ad8e0 con 0x7f2d180b89d0 2024-03-23T23:58:28.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d0fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d180b4bf0 0x7f2d180b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d0fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d180b4bf0 0x7f2d180b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43900/0 (socket says 172.21.15.31:43900) 2024-03-23T23:58:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d0fe00640 1 -- 172.21.15.31:0/2917585707 learned_addr learned my addr 172.21.15.31:0/2917585707 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d1d600640 1 --2- 172.21.15.31:0/2917585707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b89d0 0x7f2d18151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d0fe00640 1 -- 172.21.15.31:0/2917585707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b89d0 msgr2=0x7f2d18151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d0fe00640 1 --2- 172.21.15.31:0/2917585707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b89d0 0x7f2d18151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.440+0000 7f2d0fe00640 1 -- 172.21.15.31:0/2917585707 >> v1:172.21.15.31:6789/0 conn(0x7f2d181413d0 legacy=0x7f2d181471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.441+0000 7f2d0fe00640 1 -- 172.21.15.31:0/2917585707 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b8e80 con 0x7f2d180b4bf0 2024-03-23T23:58:28.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.442+0000 7f2d0fe00640 1 --2- 172.21.15.31:0/2917585707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b4bf0 0x7f2d180b8490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009870 tx=0x7f2d0002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3101b0a208105e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.442+0000 7f2d17e00640 1 -- 172.21.15.31:0/2917585707 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00034070 con 0x7f2d180b4bf0 2024-03-23T23:58:28.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.442+0000 7f2d17e00640 1 -- 172.21.15.31:0/2917585707 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d00030840 con 0x7f2d180b4bf0 2024-03-23T23:58:28.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.442+0000 7f2d17e00640 1 -- 172.21.15.31:0/2917585707 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00030c10 con 0x7f2d180b4bf0 2024-03-23T23:58:28.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 -- 172.21.15.31:0/2917585707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b4bf0 msgr2=0x7f2d180b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 --2- 172.21.15.31:0/2917585707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b4bf0 0x7f2d180b8490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009870 tx=0x7f2d0002b980 comp rx=0 tx=0).stop 2024-03-23T23:58:28.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 -- 172.21.15.31:0/2917585707 shutdown_connections 2024-03-23T23:58:28.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 --2- 172.21.15.31:0/2917585707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b89d0 0x7f2d18151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 --2- 172.21.15.31:0/2917585707 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b4bf0 0x7f2d180b8490 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 -- 172.21.15.31:0/2917585707 >> 172.21.15.31:0/2917585707 conn(0x7f2d1806b990 msgr2=0x7f2d1806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 -- 172.21.15.31:0/2917585707 shutdown_connections 2024-03-23T23:58:28.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.443+0000 7f2d1e000640 1 -- 172.21.15.31:0/2917585707 wait complete. 2024-03-23T23:58:28.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.445+0000 7f2d1e000640 1 Processor -- start 2024-03-23T23:58:28.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.445+0000 7f2d1e000640 1 -- start start 2024-03-23T23:58:28.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d1e000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b4bf0 0x7f2d180b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d1e000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b89d0 0x7f2d180b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d1e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d181413d0 0x7f2d180b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d1e000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180af6b0 con 0x7f2d180b89d0 2024-03-23T23:58:28.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d1e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180af530 con 0x7f2d181413d0 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d1e000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1809e000 con 0x7f2d180b4bf0 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b89d0 0x7f2d180b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b89d0 0x7f2d180b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43906/0 (socket says 172.21.15.31:43906) 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.446+0000 7f2d0fe00640 1 -- 172.21.15.31:0/4085679652 learned_addr learned my addr 172.21.15.31:0/4085679652 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d1d600640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d181413d0 0x7f2d180b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d1cc00640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b4bf0 0x7f2d180b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d0fe00640 1 -- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b4bf0 msgr2=0x7f2d180b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d0fe00640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b4bf0 0x7f2d180b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d0fe00640 1 -- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d181413d0 msgr2=0x7f2d180b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d0fe00640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d181413d0 0x7f2d180b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d0fe00640 1 -- 172.21.15.31:0/4085679652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b1d10 con 0x7f2d180b89d0 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d1cc00640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d180b4bf0 0x7f2d180b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.447+0000 7f2d0fe00640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b89d0 0x7f2d180b04e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d0002b9c0 tx=0x7f2d00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.448+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00048070 con 0x7f2d180b89d0 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.448+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d00030640 con 0x7f2d180b89d0 2024-03-23T23:58:28.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.448+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00034040 con 0x7f2d180b89d0 2024-03-23T23:58:28.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.448+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d18147020 con 0x7f2d180b89d0 2024-03-23T23:58:28.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.448+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d180affc0 con 0x7f2d180b89d0 2024-03-23T23:58:28.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.449+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d180752c0 con 0x7f2d180b89d0 2024-03-23T23:58:28.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.450+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2d00037070 con 0x7f2d180b89d0 2024-03-23T23:58:28.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.451+0000 7f2d15600640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2cf406bc00 0x7f2cf406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.451+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f2d000ac830 con 0x7f2d180b89d0 2024-03-23T23:58:28.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.451+0000 7f2d15600640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f2cf4073fe0 0x7f2cf4076460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.451+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 --> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d00031ec0 con 0x7f2cf4073fe0 2024-03-23T23:58:28.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.451+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d000b12c0 con 0x7f2d180b89d0 2024-03-23T23:58:28.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.451+0000 7f2d1cc00640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2cf406bc00 0x7f2cf406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.451+0000 7f2d1d600640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f2cf4073fe0 0x7f2cf4076460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.452+0000 7f2d1d600640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f2cf4073fe0 0x7f2cf4076460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.453+0000 7f2d1cc00640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2cf406bc00 0x7f2cf406e0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2d08001cd0 tx=0x7f2d08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.453+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== osd.3 v2:172.21.15.31:6823/2450082534 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2d00031ec0 con 0x7f2cf4073fe0 2024-03-23T23:58:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.468+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 --> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2d180ae910 con 0x7f2cf4073fe0 2024-03-23T23:58:28.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.468+0000 7f2d15600640 1 -- 172.21.15.31:0/4085679652 <== osd.3 v2:172.21.15.31:6823/2450082534 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2d180ae910 con 0x7f2cf4073fe0 2024-03-23T23:58:28.469 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:28.469 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:28.469 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:28.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f2cf4073fe0 msgr2=0x7f2cf4076460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:6823/2450082534,v1:172.21.15.31:6825/2450082534] conn(0x7f2cf4073fe0 0x7f2cf4076460 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2cf406bc00 msgr2=0x7f2cf406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2cf406bc00 0x7f2cf406e0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2d08001cd0 tx=0x7f2d08009040 comp rx=0 tx=0).stop 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b89d0 msgr2=0x7f2d180b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 --2- 172.21.15.31:0/4085679652 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d180b89d0 0x7f2d180b04e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d0002b9c0 tx=0x7f2d00004730 comp rx=0 tx=0).stop 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1d600640 1 -- 172.21.15.31:0/4085679652 reap_dead start 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 shutdown_connections 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.469+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 >> 172.21.15.31:0/4085679652 conn(0x7f2d1806b990 msgr2=0x7f2d180b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.470+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 shutdown_connections 2024-03-23T23:58:28.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.470+0000 7f2d1e000640 1 -- 172.21.15.31:0/4085679652 wait complete. 2024-03-23T23:58:28.487 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-23T23:58:28.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.707+0000 7f8c0f000640 1 Processor -- start 2024-03-23T23:58:28.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.708+0000 7f8c0f000640 1 -- start start 2024-03-23T23:58:28.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.709+0000 7f8c0f000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c080b41b0 0x7f8c080b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.709+0000 7f8c0f000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08140e00 0x7f8c081412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.709+0000 7f8c0f000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c080b4590 con 0x7f8c080b6d30 2024-03-23T23:58:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.709+0000 7f8c0f000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c080b56c0 con 0x7f8c080b41b0 2024-03-23T23:58:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.709+0000 7f8c0f000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c080b9930 con 0x7f8c08140e00 2024-03-23T23:58:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0dc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c080b41b0 0x7f8c080b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0dc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8c080b41b0 0x7f8c080b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43910/0 (socket says 172.21.15.31:43910) 2024-03-23T23:58:28.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0dc00640 1 -- 172.21.15.31:0/2574150688 learned_addr learned my addr 172.21.15.31:0/2574150688 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:28.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0dc00640 1 -- 172.21.15.31:0/2574150688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08140e00 msgr2=0x7f8c081412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:28.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0e600640 1 --2- 172.21.15.31:0/2574150688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08140e00 0x7f8c081412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0dc00640 1 --2- 172.21.15.31:0/2574150688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08140e00 0x7f8c081412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0dc00640 1 -- 172.21.15.31:0/2574150688 >> v1:172.21.15.59:6789/0 conn(0x7f8c080b6d30 legacy=0x7f8c081471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:28.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.710+0000 7f8c0dc00640 1 -- 172.21.15.31:0/2574150688 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c080b9c10 con 0x7f8c080b41b0 2024-03-23T23:58:28.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.711+0000 7f8c0dc00640 1 --2- 172.21.15.31:0/2574150688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b41b0 0x7f8c080b50a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009e50 tx=0x7f8bfc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de0dfaab57795eb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.712+0000 7f8c07e00640 1 -- 172.21.15.31:0/2574150688 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc02ca70 con 0x7f8c080b41b0 2024-03-23T23:58:28.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.712+0000 7f8c07e00640 1 -- 172.21.15.31:0/2574150688 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc02cc10 con 0x7f8c080b41b0 2024-03-23T23:58:28.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.712+0000 7f8c07e00640 1 -- 172.21.15.31:0/2574150688 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0343f0 con 0x7f8c080b41b0 2024-03-23T23:58:28.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.712+0000 7f8c0f000640 1 -- 172.21.15.31:0/2574150688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b41b0 msgr2=0x7f8c080b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.712+0000 7f8c0f000640 1 --2- 172.21.15.31:0/2574150688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b41b0 0x7f8c080b50a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009e50 tx=0x7f8bfc02bed0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.713+0000 7f8c0f000640 1 -- 172.21.15.31:0/2574150688 shutdown_connections 2024-03-23T23:58:28.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.713+0000 7f8c0f000640 1 --2- 172.21.15.31:0/2574150688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c08140e00 0x7f8c081412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.713+0000 7f8c0f000640 1 --2- 172.21.15.31:0/2574150688 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c080b41b0 0x7f8c080b50a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.713+0000 7f8c0f000640 1 -- 172.21.15.31:0/2574150688 >> 172.21.15.31:0/2574150688 conn(0x7f8c08066fb0 msgr2=0x7f8c080673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.713+0000 7f8c0f000640 1 -- 172.21.15.31:0/2574150688 shutdown_connections 2024-03-23T23:58:28.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.713+0000 7f8c0f000640 1 -- 172.21.15.31:0/2574150688 wait complete. 2024-03-23T23:58:28.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.714+0000 7f8c0f000640 1 Processor -- start 2024-03-23T23:58:28.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.714+0000 7f8c0f000640 1 -- start start 2024-03-23T23:58:28.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.715+0000 7f8c0f000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c080b41b0 0x7f8c08149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.715+0000 7f8c0f000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c08140e00 0x7f8c081e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.715+0000 7f8c0f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c081e0650 0x7f8c08148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.715+0000 7f8c0f000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c08141970 con 0x7f8c08140e00 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.715+0000 7f8c0f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c081417f0 con 0x7f8c081e0650 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.715+0000 7f8c0f000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c081478f0 con 0x7f8c080b41b0 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.715+0000 7f8c0d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c08140e00 0x7f8c081e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c08140e00 0x7f8c081e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43920/0 (socket says 172.21.15.31:43920) 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 -- 172.21.15.31:0/3164522902 learned_addr learned my addr 172.21.15.31:0/3164522902 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0e600640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c081e0650 0x7f8c08148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0dc00640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c080b41b0 0x7f8c08149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 -- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c080b41b0 msgr2=0x7f8c08149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c080b41b0 0x7f8c08149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 -- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c081e0650 msgr2=0x7f8c08148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c081e0650 0x7f8c08148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 -- 172.21.15.31:0/3164522902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0814b530 con 0x7f8c08140e00 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0e600640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c081e0650 0x7f8c08148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c0d200640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c08140e00 0x7f8c081e0110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c430 tx=0x7f8bf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.716+0000 7f8c05600640 1 -- 172.21.15.31:0/3164522902 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4011790 con 0x7f8c08140e00 2024-03-23T23:58:28.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.717+0000 7f8c05600640 1 -- 172.21.15.31:0/3164522902 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf4017070 con 0x7f8c08140e00 2024-03-23T23:58:28.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.717+0000 7f8c05600640 1 -- 172.21.15.31:0/3164522902 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4011bb0 con 0x7f8c08140e00 2024-03-23T23:58:28.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.717+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0814a390 con 0x7f8c08140e00 2024-03-23T23:58:28.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.717+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c08144cf0 con 0x7f8c08140e00 2024-03-23T23:58:28.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.718+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c081e0a60 con 0x7f8c08140e00 2024-03-23T23:58:28.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.719+0000 7f8c05600640 1 -- 172.21.15.31:0/3164522902 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8bf401c460 con 0x7f8c08140e00 2024-03-23T23:58:28.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.720+0000 7f8c05600640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8be806bbd0 0x7f8be806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:28.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.720+0000 7f8c05600640 1 -- 172.21.15.31:0/3164522902 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f8bf408aa00 con 0x7f8c08140e00 2024-03-23T23:58:28.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.721+0000 7f8c0dc00640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8be806bbd0 0x7f8be806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:28.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.722+0000 7f8c0dc00640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8be806bbd0 0x7f8be806e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc035000 tx=0x7f8bfc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:28.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.726+0000 7f8c05600640 1 -- 172.21.15.31:0/3164522902 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f8c081e0a60 con 0x7f8c08140e00 2024-03-23T23:58:28.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.931+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c080752c0 con 0x7f8be806bbd0 2024-03-23T23:58:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.932+0000 7f8c05600640 1 -- 172.21.15.31:0/3164522902 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8c080752c0 con 0x7f8be806bbd0 2024-03-23T23:58:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-03-23T23:58:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8be806bbd0 msgr2=0x7f8be806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8be806bbd0 0x7f8be806e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc035000 tx=0x7f8bfc030000 comp rx=0 tx=0).stop 2024-03-23T23:58:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c08140e00 msgr2=0x7f8c081e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c08140e00 0x7f8c081e0110 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c430 tx=0x7f8bf400c8f0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 shutdown_connections 2024-03-23T23:58:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f8be806bbd0 0x7f8be806e090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c081e0650 0x7f8c08148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8c08140e00 0x7f8c081e0110 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 --2- 172.21.15.31:0/3164522902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c080b41b0 0x7f8c08149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 >> 172.21.15.31:0/3164522902 conn(0x7f8c08066fb0 msgr2=0x7f8c08067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 shutdown_connections 2024-03-23T23:58:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:28.936+0000 7f8c0f000640 1 -- 172.21.15.31:0/3164522902 wait complete. 2024-03-23T23:58:28.955 INFO:tasks.ceph:Scrubbing osd.4 2024-03-23T23:58:28.955 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:29.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.179+0000 7fb66f200640 1 Processor -- start 2024-03-23T23:58:29.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.179+0000 7fb66f200640 1 -- start start 2024-03-23T23:58:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.180+0000 7fb66f200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb668072eb0 0x7fb668145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.180+0000 7fb66f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 0x7fb6680b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.180+0000 7fb66f200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6680b8870 con 0x7fb668073290 2024-03-23T23:58:29.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.180+0000 7fb66f200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6680b8b50 con 0x7fb668072eb0 2024-03-23T23:58:29.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.180+0000 7fb66f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66809d820 con 0x7fb66809bf50 2024-03-23T23:58:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.181+0000 7fb66d400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb668073290 0x7fb66809dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56830/0 (socket says 172.21.15.31:56830) 2024-03-23T23:58:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.181+0000 7fb66d400640 1 -- 172.21.15.31:0/1852696411 learned_addr learned my addr 172.21.15.31:0/1852696411 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.181+0000 7fb66e800640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 0x7fb6680b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.181+0000 7fb66de00640 1 --2- 172.21.15.31:0/1852696411 >> v2:172.21.15.59:3300/0 conn(0x7fb668072eb0 0x7fb668145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.181+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276908927 0 0) 0x7fb6680b8870 con 0x7fb668073290 2024-03-23T23:58:29.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb650003520 con 0x7fb668073290 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 730826531 0 0) 0x7fb650003520 con 0x7fb668073290 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 msgr2=0x7fb6680b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 0x7fb6680b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 >> v2:172.21.15.59:3300/0 conn(0x7fb668072eb0 msgr2=0x7fb668145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 --2- 172.21.15.31:0/1852696411 >> v2:172.21.15.59:3300/0 conn(0x7fb668072eb0 0x7fb668145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6680b9380 con 0x7fb668073290 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fb658001670 con 0x7fb668073290 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 >> v1:172.21.15.31:6789/0 conn(0x7fb668073290 legacy=0x7fb66809dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb650003a20 0x7fb650003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 0x7fb650004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb650004d40 0x7fb6500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680b8b50 con 0x7fb650003a20 2024-03-23T23:58:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66809d820 con 0x7fb650004d40 2024-03-23T23:58:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65000ba10 con 0x7fb66809bf50 2024-03-23T23:58:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.182+0000 7fb66de00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb650003a20 0x7fb650003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.183+0000 7fb66d400640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 0x7fb650004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.183+0000 7fb66de00640 1 -- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 msgr2=0x7fb650004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.183+0000 7fb66de00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb66809bf50 0x7fb650004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.183+0000 7fb66de00640 1 -- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb650004d40 msgr2=0x7fb6500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.183+0000 7fb66de00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb650004d40 0x7fb6500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.183+0000 7fb66de00640 1 -- 172.21.15.31:0/1852696411 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650003520 con 0x7fb650003a20 2024-03-23T23:58:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.184+0000 7fb66de00640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb650003a20 0x7fb650003e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009ac0 tx=0x7fb650005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561925c7419b6115 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.184+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c039070 con 0x7fb650003a20 2024-03-23T23:58:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.184+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c02c710 con 0x7fb650003a20 2024-03-23T23:58:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.184+0000 7fb66ca00640 1 -- 172.21.15.31:0/1852696411 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c009690 con 0x7fb650003a20 2024-03-23T23:58:29.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.185+0000 7fb66f200640 1 -- 172.21.15.31:0/1852696411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb650003a20 msgr2=0x7fb650003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.185+0000 7fb66f200640 1 --2- 172.21.15.31:0/1852696411 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb650003a20 0x7fb650003e40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb65c009ac0 tx=0x7fb650005830 comp rx=0 tx=0).stop 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.185+0000 7fb66e800640 1 -- 172.21.15.31:0/1852696411 reap_dead start 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.185+0000 7fb66f200640 1 -- 172.21.15.31:0/1852696411 shutdown_connections 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.185+0000 7fb66f200640 1 -- 172.21.15.31:0/1852696411 >> 172.21.15.31:0/1852696411 conn(0x7fb66806b990 msgr2=0x7fb66806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.185+0000 7fb66f200640 1 -- 172.21.15.31:0/1852696411 shutdown_connections 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.185+0000 7fb66f200640 1 -- 172.21.15.31:0/1852696411 wait complete. 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.187+0000 7fb66f200640 1 Processor -- start 2024-03-23T23:58:29.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.187+0000 7fb66f200640 1 -- start start 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb650003a20 0x7fb668147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb66813dd70 0x7fb66813e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6681dca40 0x7fb6681dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680b4490 con 0x7fb66813dd70 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680b4310 con 0x7fb650003a20 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680b4610 con 0x7fb6681dca40 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb66813dd70 0x7fb66813e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb66813dd70 0x7fb66813e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43940/0 (socket says 172.21.15.31:43940) 2024-03-23T23:58:29.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 -- 172.21.15.31:0/111725113 learned_addr learned my addr 172.21.15.31:0/111725113 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:29.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 -- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6681dca40 msgr2=0x7fb6681dcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66e800640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6681dca40 0x7fb6681dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6681dca40 0x7fb6681dcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 -- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb650003a20 msgr2=0x7fb668147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb650003a20 0x7fb668147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.188+0000 7fb66d400640 1 -- 172.21.15.31:0/111725113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668148b20 con 0x7fb66813dd70 2024-03-23T23:58:29.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.189+0000 7fb66d400640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb66813dd70 0x7fb66813e1f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb65800d7a0 tx=0x7fb65800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.189+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658019070 con 0x7fb66813dd70 2024-03-23T23:58:29.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.189+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6580074e0 con 0x7fb66813dd70 2024-03-23T23:58:29.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.189+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658004a20 con 0x7fb66813dd70 2024-03-23T23:58:29.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.189+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb668147990 con 0x7fb66813dd70 2024-03-23T23:58:29.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.189+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb668148840 con 0x7fb66813dd70 2024-03-23T23:58:29.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.190+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6681477b0 con 0x7fb66813dd70 2024-03-23T23:58:29.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.191+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb65801c070 con 0x7fb66813dd70 2024-03-23T23:58:29.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.192+0000 7fb662000640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb64c06bc20 0x7fb64c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.192+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7fb65808a420 con 0x7fb66813dd70 2024-03-23T23:58:29.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.193+0000 7fb662000640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7fb64c074080 0x7fb64c076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.193+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 --> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb64c076bd0 con 0x7fb64c074080 2024-03-23T23:58:29.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.193+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb658091050 con 0x7fb66813dd70 2024-03-23T23:58:29.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.193+0000 7fb66de00640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb64c06bc20 0x7fb64c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.193+0000 7fb66e800640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7fb64c074080 0x7fb64c076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.194+0000 7fb66de00640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb64c06bc20 0x7fb64c06e0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65c036000 tx=0x7fb65c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.194+0000 7fb66e800640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7fb64c074080 0x7fb64c076500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.196+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== osd.4 v2:172.21.15.59:6817/2529462705 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb64c076bd0 con 0x7fb64c074080 2024-03-23T23:58:29.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.212+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 --> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb6680752c0 con 0x7fb64c074080 2024-03-23T23:58:29.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb662000640 1 -- 172.21.15.31:0/111725113 <== osd.4 v2:172.21.15.59:6817/2529462705 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb6680752c0 con 0x7fb64c074080 2024-03-23T23:58:29.213 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:29.213 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:29.213 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7fb64c074080 msgr2=0x7fb64c076500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6817/2529462705,v1:172.21.15.59:6819/2529462705] conn(0x7fb64c074080 0x7fb64c076500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb64c06bc20 msgr2=0x7fb64c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb64c06bc20 0x7fb64c06e0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb65c036000 tx=0x7fb65c02e000 comp rx=0 tx=0).stop 2024-03-23T23:58:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb66813dd70 msgr2=0x7fb66813e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 --2- 172.21.15.31:0/111725113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb66813dd70 0x7fb66813e1f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb65800d7a0 tx=0x7fb65800dc60 comp rx=0 tx=0).stop 2024-03-23T23:58:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66e800640 1 -- 172.21.15.31:0/111725113 reap_dead start 2024-03-23T23:58:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 shutdown_connections 2024-03-23T23:58:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.213+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 >> 172.21.15.31:0/111725113 conn(0x7fb66806b990 msgr2=0x7fb6681435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.214+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 shutdown_connections 2024-03-23T23:58:29.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.214+0000 7fb66f200640 1 -- 172.21.15.31:0/111725113 wait complete. 2024-03-23T23:58:29.233 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-23T23:58:29.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.456+0000 7fb7ad600640 1 Processor -- start 2024-03-23T23:58:29.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.456+0000 7fb7ad600640 1 -- start start 2024-03-23T23:58:29.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.457+0000 7fb7ad600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7a80b6a30 0x7fb7a80b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.457+0000 7fb7ad600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 0x7fb7a8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.457+0000 7fb7ad600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a80b6e10 con 0x7fb7a80b7530 2024-03-23T23:58:29.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.457+0000 7fb7ad600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a80b3480 con 0x7fb7a80b6a30 2024-03-23T23:58:29.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.457+0000 7fb7ad600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b36d0 con 0x7fb7a8144a20 2024-03-23T23:58:29.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.457+0000 7fb7a7400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb7a80b7530 0x7fb7a8144310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56834/0 (socket says 172.21.15.31:56834) 2024-03-23T23:58:29.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a7400640 1 -- 172.21.15.31:0/1862386028 learned_addr learned my addr 172.21.15.31:0/1862386028 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:29.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a7e00640 1 --2- 172.21.15.31:0/1862386028 >> v2:172.21.15.59:3300/0 conn(0x7fb7a80b6a30 0x7fb7a80b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7acc00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 0x7fb7a8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142839356 0 0) 0x7fb7a80b6e10 con 0x7fb7a80b7530 2024-03-23T23:58:29.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb78c003520 con 0x7fb7a80b7530 2024-03-23T23:58:29.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3052730160 0 0) 0x7fb78c003520 con 0x7fb7a80b7530 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 msgr2=0x7fb7a8151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 0x7fb7a8151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 >> v2:172.21.15.59:3300/0 conn(0x7fb7a80b6a30 msgr2=0x7fb7a80b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 --2- 172.21.15.31:0/1862386028 >> v2:172.21.15.59:3300/0 conn(0x7fb7a80b6a30 0x7fb7a80b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80b3d20 con 0x7fb7a80b7530 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fb7980019f0 con 0x7fb7a80b7530 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.458+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 >> v1:172.21.15.31:6789/0 conn(0x7fb7a80b7530 legacy=0x7fb7a8144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a6a00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 0x7fb78c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a6a00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78c003fa0 0x7fb78c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a6a00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb78c004d40 0x7fb78c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b3480 con 0x7fb78c004d40 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b36d0 con 0x7fb78c003fa0 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb78c00b9f0 con 0x7fb7a8144a20 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7acc00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb78c004d40 0x7fb78c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a7400640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78c003fa0 0x7fb78c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7a7e00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 0x7fb78c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7acc00640 1 -- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 msgr2=0x7fb78c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7acc00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7a8144a20 0x7fb78c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7acc00640 1 -- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78c003fa0 msgr2=0x7fb78c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7acc00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb78c003fa0 0x7fb78c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.459+0000 7fb7acc00640 1 -- 172.21.15.31:0/1862386028 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c003520 con 0x7fb78c004d40 2024-03-23T23:58:29.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.461+0000 7fb7acc00640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb78c004d40 0x7fb78c0051c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7a806b270 tx=0x7fb78c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5251de47b09ec43 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.461+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0039070 con 0x7fb78c004d40 2024-03-23T23:58:29.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.461+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a002c660 con 0x7fb78c004d40 2024-03-23T23:58:29.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.461+0000 7fb7a6a00640 1 -- 172.21.15.31:0/1862386028 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0009690 con 0x7fb78c004d40 2024-03-23T23:58:29.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.461+0000 7fb7ad600640 1 -- 172.21.15.31:0/1862386028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb78c004d40 msgr2=0x7fb78c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.461+0000 7fb7ad600640 1 --2- 172.21.15.31:0/1862386028 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb78c004d40 0x7fb78c0051c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7a806b270 tx=0x7fb78c005830 comp rx=0 tx=0).stop 2024-03-23T23:58:29.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.461+0000 7fb7acc00640 1 -- 172.21.15.31:0/1862386028 reap_dead start 2024-03-23T23:58:29.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.462+0000 7fb7ad600640 1 -- 172.21.15.31:0/1862386028 shutdown_connections 2024-03-23T23:58:29.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.462+0000 7fb7ad600640 1 -- 172.21.15.31:0/1862386028 >> 172.21.15.31:0/1862386028 conn(0x7fb7a806cf40 msgr2=0x7fb7a806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.462+0000 7fb7ad600640 1 -- 172.21.15.31:0/1862386028 shutdown_connections 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.462+0000 7fb7ad600640 1 -- 172.21.15.31:0/1862386028 wait complete. 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.463+0000 7fb7ad600640 1 Processor -- start 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.464+0000 7fb7ad600640 1 -- start start 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.464+0000 7fb7ad600640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb78c004d40 0x7fb7a80b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.464+0000 7fb7ad600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7a814abf0 0x7fb7a80b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.464+0000 7fb7ad600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a81dfc40 0x7fb7a81e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.464+0000 7fb7ad600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b8b80 con 0x7fb7a81dfc40 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.464+0000 7fb7ad600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b42e0 con 0x7fb7a814abf0 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.464+0000 7fb7ad600640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80afcc0 con 0x7fb78c004d40 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a81dfc40 0x7fb7a81e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a81dfc40 0x7fb7a81e00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43950/0 (socket says 172.21.15.31:43950) 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 -- 172.21.15.31:0/488031832 learned_addr learned my addr 172.21.15.31:0/488031832 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7a7e00640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb78c004d40 0x7fb7a80b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7a7400640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7a814abf0 0x7fb7a80b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 -- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb78c004d40 msgr2=0x7fb7a80b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb78c004d40 0x7fb7a80b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 -- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7a814abf0 msgr2=0x7fb7a80b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7a814abf0 0x7fb7a80b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.465+0000 7fb7acc00640 1 -- 172.21.15.31:0/488031832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80b1ac0 con 0x7fb7a81dfc40 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.466+0000 7fb7acc00640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a81dfc40 0x7fb7a81e00c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009b80 tx=0x7fb7a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.466+0000 7fb79fe00640 1 -- 172.21.15.31:0/488031832 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0039070 con 0x7fb7a81dfc40 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.466+0000 7fb79fe00640 1 -- 172.21.15.31:0/488031832 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0043070 con 0x7fb7a81dfc40 2024-03-23T23:58:29.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.466+0000 7fb79fe00640 1 -- 172.21.15.31:0/488031832 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0009690 con 0x7fb7a81dfc40 2024-03-23T23:58:29.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.466+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a80b0210 con 0x7fb7a81dfc40 2024-03-23T23:58:29.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.466+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a814a050 con 0x7fb7a81dfc40 2024-03-23T23:58:29.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.467+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a80752c0 con 0x7fb7a81dfc40 2024-03-23T23:58:29.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.468+0000 7fb79fe00640 1 -- 172.21.15.31:0/488031832 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb7a0034a90 con 0x7fb7a81dfc40 2024-03-23T23:58:29.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.469+0000 7fb79fe00640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb78406bbd0 0x7fb78406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.469+0000 7fb79fe00640 1 -- 172.21.15.31:0/488031832 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7fb7a00ab970 con 0x7fb7a81dfc40 2024-03-23T23:58:29.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.470+0000 7fb7a7e00640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb78406bbd0 0x7fb78406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.471+0000 7fb7a7e00640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb78406bbd0 0x7fb78406e090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb790009a90 tx=0x7fb790008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.474+0000 7fb79fe00640 1 -- 172.21.15.31:0/488031832 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fb7a007a320 con 0x7fb7a81dfc40 2024-03-23T23:58:29.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.682+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7a80b0650 con 0x7fb78406bbd0 2024-03-23T23:58:29.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.683+0000 7fb79fe00640 1 -- 172.21.15.31:0/488031832 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7a80b0650 con 0x7fb78406bbd0 2024-03-23T23:58:29.683 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 4 to deep-scrub 2024-03-23T23:58:29.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb78406bbd0 msgr2=0x7fb78406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb78406bbd0 0x7fb78406e090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb790009a90 tx=0x7fb790008040 comp rx=0 tx=0).stop 2024-03-23T23:58:29.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a81dfc40 msgr2=0x7fb7a81e00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a81dfc40 0x7fb7a81e00c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009b80 tx=0x7fb7a0004730 comp rx=0 tx=0).stop 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 shutdown_connections 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb78406bbd0 0x7fb78406e090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7a814abf0 0x7fb7a80b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7a81dfc40 0x7fb7a81e00c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 --2- 172.21.15.31:0/488031832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb78c004d40 0x7fb7a80b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 >> 172.21.15.31:0/488031832 conn(0x7fb7a806cf40 msgr2=0x7fb7a81478c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 shutdown_connections 2024-03-23T23:58:29.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.686+0000 7fb7ad600640 1 -- 172.21.15.31:0/488031832 wait complete. 2024-03-23T23:58:29.707 INFO:tasks.ceph:Scrubbing osd.5 2024-03-23T23:58:29.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:29.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.935+0000 7f9d73a00640 1 Processor -- start 2024-03-23T23:58:29.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.935+0000 7f9d73a00640 1 -- start start 2024-03-23T23:58:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.936+0000 7f9d73a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 0x7f9d6c0b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.936+0000 7f9d73a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c0b1da0 con 0x7f9d6c0b0020 2024-03-23T23:58:29.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.936+0000 7f9d73a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6c0b2cb0 con 0x7f9d6c072540 2024-03-23T23:58:29.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.936+0000 7f9d73a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14f650 con 0x7f9d6c14ee10 2024-03-23T23:58:29.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6be00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9d6c0b0020 0x7f9d6c0b0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56842/0 (socket says 172.21.15.31:56842) 2024-03-23T23:58:29.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6be00640 1 -- 172.21.15.31:0/240967532 learned_addr learned my addr 172.21.15.31:0/240967532 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:29.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d71000640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 0x7f9d6c0b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697299048 0 0) 0x7f9d6c0b1da0 con 0x7f9d6c0b0020 2024-03-23T23:58:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d54003520 con 0x7f9d6c0b0020 2024-03-23T23:58:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2543348028 0 0) 0x7f9d54003520 con 0x7f9d6c0b0020 2024-03-23T23:58:29.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 msgr2=0x7f9d6c0b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6b400640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 0x7f9d6c0b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 >> v1:172.21.15.59:6789/0 conn(0x7f9d6c072540 legacy=0x7f9d6c0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.937+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c14f930 con 0x7f9d6c0b0020 2024-03-23T23:58:29.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f9d5c001670 con 0x7f9d6c0b0020 2024-03-23T23:58:29.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 >> v1:172.21.15.31:6789/0 conn(0x7f9d6c0b0020 legacy=0x7f9d6c0b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d540039e0 0x7f9d54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 0x7f9d54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d54004d40 0x7f9d540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14f650 con 0x7f9d54004d40 2024-03-23T23:58:29.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5400bb50 con 0x7f9d540039e0 2024-03-23T23:58:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5400bd50 con 0x7f9d6c14ee10 2024-03-23T23:58:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d71a00640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d54004d40 0x7f9d540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d6be00640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 0x7f9d54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d71a00640 1 -- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 msgr2=0x7f9d54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d71000640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d540039e0 0x7f9d54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d71a00640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c14ee10 0x7f9d54004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d71a00640 1 -- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d540039e0 msgr2=0x7f9d54003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d71a00640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d540039e0 0x7f9d54003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.938+0000 7f9d71a00640 1 -- 172.21.15.31:0/240967532 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54003520 con 0x7f9d54004d40 2024-03-23T23:58:29.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.939+0000 7f9d71a00640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d54004d40 0x7f9d540051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d64001e50 tx=0x7f9d54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84ba20679c8f39c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64001a70 con 0x7f9d54004d40 2024-03-23T23:58:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d64003b70 con 0x7f9d54004d40 2024-03-23T23:58:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d6b400640 1 -- 172.21.15.31:0/240967532 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d640050d0 con 0x7f9d54004d40 2024-03-23T23:58:29.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d73a00640 1 -- 172.21.15.31:0/240967532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d54004d40 msgr2=0x7f9d540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d73a00640 1 --2- 172.21.15.31:0/240967532 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d54004d40 0x7f9d540051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9d64001e50 tx=0x7f9d54005830 comp rx=0 tx=0).stop 2024-03-23T23:58:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d71a00640 1 -- 172.21.15.31:0/240967532 reap_dead start 2024-03-23T23:58:29.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d73a00640 1 -- 172.21.15.31:0/240967532 shutdown_connections 2024-03-23T23:58:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.940+0000 7f9d73a00640 1 -- 172.21.15.31:0/240967532 >> 172.21.15.31:0/240967532 conn(0x7f9d6c0b8970 msgr2=0x7f9d6c0b8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.941+0000 7f9d73a00640 1 -- 172.21.15.31:0/240967532 shutdown_connections 2024-03-23T23:58:29.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.941+0000 7f9d73a00640 1 -- 172.21.15.31:0/240967532 wait complete. 2024-03-23T23:58:29.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.942+0000 7f9d73a00640 1 Processor -- start 2024-03-23T23:58:29.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.942+0000 7f9d73a00640 1 -- start start 2024-03-23T23:58:29.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d73a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d54004d40 0x7f9d6c149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d73a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d6c1e11b0 0x7f9d6c1e1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d73a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c0aead0 0x7f9d6c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d73a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14f370 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d73a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c14f1f0 con 0x7f9d54004d40 2024-03-23T23:58:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d73a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c0b1860 con 0x7f9d6c0aead0 2024-03-23T23:58:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d6c1e11b0 0x7f9d6c1e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d6be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d6c1e11b0 0x7f9d6c1e1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43956/0 (socket says 172.21.15.31:43956) 2024-03-23T23:58:29.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.943+0000 7f9d6be00640 1 -- 172.21.15.31:0/1835999911 learned_addr learned my addr 172.21.15.31:0/1835999911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d71000640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d54004d40 0x7f9d6c149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d71a00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c0aead0 0x7f9d6c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d6be00640 1 -- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c0aead0 msgr2=0x7f9d6c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d6be00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c0aead0 0x7f9d6c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d6be00640 1 -- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d54004d40 msgr2=0x7f9d6c149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d6be00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d54004d40 0x7f9d6c149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.969 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d6be00640 1 -- 172.21.15.31:0/1835999911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6c14c500 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d71a00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d6c0aead0 0x7f9d6c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:29.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d6be00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d6c1e11b0 0x7f9d6c1e1630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d7a0 tx=0x7f9d5c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c019070 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c00de50 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0047e0 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.944+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c14c220 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.945+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c14a420 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.946+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d6c0af490 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.947+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9d5c004980 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.948+0000 7f9d68c00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9d5006bbd0 0x7f9d5006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.948+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f9d5c08a5a0 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.948+0000 7f9d68c00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7f9d50073fb0 0x7f9d50076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:29.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.948+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d5c004e50 con 0x7f9d50073fb0 2024-03-23T23:58:29.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.948+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d5c091050 con 0x7f9d6c1e11b0 2024-03-23T23:58:29.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.948+0000 7f9d71000640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9d5006bbd0 0x7f9d5006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.948+0000 7f9d71a00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7f9d50073fb0 0x7f9d50076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:29.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.950+0000 7f9d71a00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7f9d50073fb0 0x7f9d50076430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.950+0000 7f9d71000640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9d5006bbd0 0x7f9d5006e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c149540 tx=0x7f9d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:29.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.953+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== osd.5 v2:172.21.15.59:6800/814178259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9d5c004e50 con 0x7f9d50073fb0 2024-03-23T23:58:29.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.968+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 --> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9d6c0b3060 con 0x7f9d50073fb0 2024-03-23T23:58:29.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.969+0000 7f9d68c00640 1 -- 172.21.15.31:0/1835999911 <== osd.5 v2:172.21.15.59:6800/814178259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9d6c0b3060 con 0x7f9d50073fb0 2024-03-23T23:58:29.976 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:29.977 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:29.977 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:29.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7f9d50073fb0 msgr2=0x7f9d50076430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6800/814178259,v1:172.21.15.59:6801/814178259] conn(0x7f9d50073fb0 0x7f9d50076430 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:29.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9d5006bbd0 msgr2=0x7f9d5006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f9d5006bbd0 0x7f9d5006e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c149540 tx=0x7f9d60008040 comp rx=0 tx=0).stop 2024-03-23T23:58:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d6c1e11b0 msgr2=0x7f9d6c1e1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 --2- 172.21.15.31:0/1835999911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d6c1e11b0 0x7f9d6c1e1630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d7a0 tx=0x7f9d5c00dc60 comp rx=0 tx=0).stop 2024-03-23T23:58:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d71a00640 1 -- 172.21.15.31:0/1835999911 reap_dead start 2024-03-23T23:58:29.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 shutdown_connections 2024-03-23T23:58:29.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.970+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 >> 172.21.15.31:0/1835999911 conn(0x7f9d6c0b8970 msgr2=0x7f9d6c0b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:29.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.971+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 shutdown_connections 2024-03-23T23:58:29.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:29.971+0000 7f9d73a00640 1 -- 172.21.15.31:0/1835999911 wait complete. 2024-03-23T23:58:29.989 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-23T23:58:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.208+0000 7fb70f200640 1 Processor -- start 2024-03-23T23:58:30.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.208+0000 7fb70f200640 1 -- start start 2024-03-23T23:58:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.210+0000 7fb70f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7101509a0 0x7fb710152d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.210+0000 7fb70f200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7100b5710 con 0x7fb7100b5330 2024-03-23T23:58:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.210+0000 7fb70f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71006e110 con 0x7fb71006d1f0 2024-03-23T23:58:30.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.210+0000 7fb70f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71006de30 con 0x7fb7101509a0 2024-03-23T23:58:30.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.210+0000 7fb70de00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb7100b5330 0x7fb710072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56856/0 (socket says 172.21.15.31:56856) 2024-03-23T23:58:30.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.210+0000 7fb70de00640 1 -- 172.21.15.31:0/544660369 learned_addr learned my addr 172.21.15.31:0/544660369 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:30.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70e800640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7101509a0 0x7fb710152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593010414 0 0) 0x7fb7100b5710 con 0x7fb7100b5330 2024-03-23T23:58:30.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f4003520 con 0x7fb7100b5330 2024-03-23T23:58:30.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1947467873 0 0) 0x7fb6f4003520 con 0x7fb7100b5330 2024-03-23T23:58:30.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7101509a0 msgr2=0x7fb710152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7101509a0 0x7fb710152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 >> v1:172.21.15.59:6789/0 conn(0x7fb71006d1f0 legacy=0x7fb710140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71006e610 con 0x7fb7100b5330 2024-03-23T23:58:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7fb700001670 con 0x7fb7100b5330 2024-03-23T23:58:30.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 >> v1:172.21.15.31:6789/0 conn(0x7fb7100b5330 legacy=0x7fb710072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4003a50 0x7fb6f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6f4004800 0x7fb6f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7101509a0 0x7fb6f4005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71006de30 con 0x7fb6f4003a50 2024-03-23T23:58:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f400bb80 con 0x7fb6f4004800 2024-03-23T23:58:30.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.211+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f400bd80 con 0x7fb7101509a0 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.212+0000 7fb70de00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4003a50 0x7fb6f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.212+0000 7fb70de00640 1 -- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7101509a0 msgr2=0x7fb6f4005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.212+0000 7fb70de00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7101509a0 0x7fb6f4005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.212+0000 7fb70de00640 1 -- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6f4004800 msgr2=0x7fb6f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.212+0000 7fb70de00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6f4004800 0x7fb6f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.212+0000 7fb70de00640 1 -- 172.21.15.31:0/544660369 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4003520 con 0x7fb6f4003a50 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.213+0000 7fb70de00640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4003a50 0x7fb6f4003e70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb70000c210 tx=0x7fb6f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e30e7a040ac83b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.213+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700007cf0 con 0x7fb6f4003a50 2024-03-23T23:58:30.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.213+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb700030070 con 0x7fb6f4003a50 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.213+0000 7fb70ca00640 1 -- 172.21.15.31:0/544660369 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb700005d30 con 0x7fb6f4003a50 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.214+0000 7fb70f200640 1 -- 172.21.15.31:0/544660369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4003a50 msgr2=0x7fb6f4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.214+0000 7fb70f200640 1 --2- 172.21.15.31:0/544660369 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6f4003a50 0x7fb6f4003e70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb70000c210 tx=0x7fb6f4005830 comp rx=0 tx=0).stop 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.214+0000 7fb70e800640 1 -- 172.21.15.31:0/544660369 reap_dead start 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.214+0000 7fb70f200640 1 -- 172.21.15.31:0/544660369 shutdown_connections 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.214+0000 7fb70f200640 1 -- 172.21.15.31:0/544660369 >> 172.21.15.31:0/544660369 conn(0x7fb7100b96b0 msgr2=0x7fb7100b9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.214+0000 7fb70f200640 1 -- 172.21.15.31:0/544660369 shutdown_connections 2024-03-23T23:58:30.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.214+0000 7fb70f200640 1 -- 172.21.15.31:0/544660369 wait complete. 2024-03-23T23:58:30.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.216+0000 7fb70f200640 1 Processor -- start 2024-03-23T23:58:30.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.216+0000 7fb70f200640 1 -- start start 2024-03-23T23:58:30.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.216+0000 7fb70f200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6f4003a50 0x7fb7100b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.216+0000 7fb70f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb71013cfd0 0x7fb7101dfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7101370e0 0x7fb7101e0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100715d0 con 0x7fb7101370e0 2024-03-23T23:58:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb710071450 con 0x7fb71013cfd0 2024-03-23T23:58:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70f200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb710141690 con 0x7fb6f4003a50 2024-03-23T23:58:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7101370e0 0x7fb7101e0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7101370e0 0x7fb7101e0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43984/0 (socket says 172.21.15.31:43984) 2024-03-23T23:58:30.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 -- 172.21.15.31:0/2204684404 learned_addr learned my addr 172.21.15.31:0/2204684404 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70d400640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb71013cfd0 0x7fb7101dfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70de00640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6f4003a50 0x7fb7100b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 -- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6f4003a50 msgr2=0x7fb7100b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6f4003a50 0x7fb7100b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 -- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb71013cfd0 msgr2=0x7fb7101dfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb71013cfd0 0x7fb7101dfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.217+0000 7fb70e800640 1 -- 172.21.15.31:0/2204684404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710137630 con 0x7fb7101370e0 2024-03-23T23:58:30.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.218+0000 7fb70e800640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7101370e0 0x7fb7101e0250 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb710148190 tx=0x7fb70800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.218+0000 7fb706000640 1 -- 172.21.15.31:0/2204684404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800c680 con 0x7fb7101370e0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.218+0000 7fb706000640 1 -- 172.21.15.31:0/2204684404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70801a070 con 0x7fb7101370e0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.218+0000 7fb706000640 1 -- 172.21.15.31:0/2204684404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800ca60 con 0x7fb7101370e0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.218+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7100b8ff0 con 0x7fb7101370e0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.218+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb710137e10 con 0x7fb7101370e0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.219+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7100752c0 con 0x7fb7101370e0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.220+0000 7fb706000640 1 -- 172.21.15.31:0/2204684404 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb70800cc00 con 0x7fb7101370e0 2024-03-23T23:58:30.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.221+0000 7fb706000640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb6f006bc00 0x7fb6f006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.221+0000 7fb706000640 1 -- 172.21.15.31:0/2204684404 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7fb70808a5f0 con 0x7fb7101370e0 2024-03-23T23:58:30.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.222+0000 7fb70de00640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb6f006bc00 0x7fb6f006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.223+0000 7fb70de00640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb6f006bc00 0x7fb6f006e0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb700034000 tx=0x7fb700007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.225+0000 7fb706000640 1 -- 172.21.15.31:0/2204684404 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fb708024020 con 0x7fb7101370e0 2024-03-23T23:58:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.426+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb710070ce0 con 0x7fb6f006bc00 2024-03-23T23:58:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.428+0000 7fb706000640 1 -- 172.21.15.31:0/2204684404 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb710070ce0 con 0x7fb6f006bc00 2024-03-23T23:58:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 5 to deep-scrub 2024-03-23T23:58:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb6f006bc00 msgr2=0x7fb6f006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb6f006bc00 0x7fb6f006e0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb700034000 tx=0x7fb700007000 comp rx=0 tx=0).stop 2024-03-23T23:58:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7101370e0 msgr2=0x7fb7101e0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7101370e0 0x7fb7101e0250 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb710148190 tx=0x7fb70800ec00 comp rx=0 tx=0).stop 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 shutdown_connections 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fb6f006bc00 0x7fb6f006e0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb71013cfd0 0x7fb7101dfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb7101370e0 0x7fb7101e0250 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.430+0000 7fb70f200640 1 --2- 172.21.15.31:0/2204684404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6f4003a50 0x7fb7100b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.431+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 >> 172.21.15.31:0/2204684404 conn(0x7fb7100b96b0 msgr2=0x7fb7100720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.431+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 shutdown_connections 2024-03-23T23:58:30.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.431+0000 7fb70f200640 1 -- 172.21.15.31:0/2204684404 wait complete. 2024-03-23T23:58:30.451 INFO:tasks.ceph:Scrubbing osd.6 2024-03-23T23:58:30.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.677+0000 7f5f05e00640 1 Processor -- start 2024-03-23T23:58:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.677+0000 7f5f05e00640 1 -- start start 2024-03-23T23:58:30.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f05e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f000ade70 0x7f5f0014e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f05e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f000b89d0 0x7f5f00155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f05e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f00145d30 con 0x7f5f0014e640 2024-03-23T23:58:30.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f05e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0014ca00 con 0x7f5f000ade70 2024-03-23T23:58:30.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f05e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f000ad9a0 con 0x7f5f000b89d0 2024-03-23T23:58:30.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f04a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f000ade70 0x7f5f0014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f04a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5f000ade70 0x7f5f0014e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43992/0 (socket says 172.21.15.31:43992) 2024-03-23T23:58:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5effe00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5f0014e640 0x7f5f0014bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56862/0 (socket says 172.21.15.31:56862) 2024-03-23T23:58:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f04a00640 1 -- 172.21.15.31:0/592280166 learned_addr learned my addr 172.21.15.31:0/592280166 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.679+0000 7f5f05400640 1 --2- 172.21.15.31:0/592280166 >> v2:172.21.15.59:3300/0 conn(0x7f5f000b89d0 0x7f5f00155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.680+0000 7f5f04a00640 1 -- 172.21.15.31:0/592280166 >> v2:172.21.15.59:3300/0 conn(0x7f5f000b89d0 msgr2=0x7f5f00155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.680+0000 7f5f04a00640 1 --2- 172.21.15.31:0/592280166 >> v2:172.21.15.59:3300/0 conn(0x7f5f000b89d0 0x7f5f00155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.680+0000 7f5f04a00640 1 -- 172.21.15.31:0/592280166 >> v1:172.21.15.31:6789/0 conn(0x7f5f0014e640 legacy=0x7f5f0014bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.680+0000 7f5f04a00640 1 -- 172.21.15.31:0/592280166 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000af100 con 0x7f5f000ade70 2024-03-23T23:58:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.680+0000 7f5f05400640 1 --2- 172.21.15.31:0/592280166 >> v2:172.21.15.59:3300/0 conn(0x7f5f000b89d0 0x7f5f00155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.680+0000 7f5eff400640 1 -- 172.21.15.31:0/592280166 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036743141 0 0) 0x7f5f00145d30 con 0x7f5f0014e640 2024-03-23T23:58:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.681+0000 7f5f04a00640 1 --2- 172.21.15.31:0/592280166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f0014e100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5f000aed40 tx=0x7f5ef402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61e4e0906b4e7c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.681+0000 7f5eff400640 1 -- 172.21.15.31:0/592280166 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef402e070 con 0x7f5f000ade70 2024-03-23T23:58:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.681+0000 7f5eff400640 1 -- 172.21.15.31:0/592280166 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef4037070 con 0x7f5f000ade70 2024-03-23T23:58:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.681+0000 7f5eff400640 1 -- 172.21.15.31:0/592280166 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4031a00 con 0x7f5f000ade70 2024-03-23T23:58:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 -- 172.21.15.31:0/592280166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 msgr2=0x7f5f0014e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 --2- 172.21.15.31:0/592280166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f0014e100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5f000aed40 tx=0x7f5ef402b880 comp rx=0 tx=0).stop 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 -- 172.21.15.31:0/592280166 shutdown_connections 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 --2- 172.21.15.31:0/592280166 >> v2:172.21.15.59:3300/0 conn(0x7f5f000b89d0 0x7f5f00155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 --2- 172.21.15.31:0/592280166 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f0014e100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 -- 172.21.15.31:0/592280166 >> 172.21.15.31:0/592280166 conn(0x7f5f0006b990 msgr2=0x7f5f0006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 -- 172.21.15.31:0/592280166 shutdown_connections 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.682+0000 7f5f05e00640 1 -- 172.21.15.31:0/592280166 wait complete. 2024-03-23T23:58:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.683+0000 7f5f05e00640 1 Processor -- start 2024-03-23T23:58:30.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.684+0000 7f5f05e00640 1 -- start start 2024-03-23T23:58:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.684+0000 7f5f05e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f000b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.684+0000 7f5f05e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f000b89d0 0x7f5f0006eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.684+0000 7f5f05e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0014e640 0x7f5f001e0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f05e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0014c3d0 con 0x7f5f000ade70 2024-03-23T23:58:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f05e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0014b7a0 con 0x7f5f000b89d0 2024-03-23T23:58:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f05e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0014c550 con 0x7f5f0014e640 2024-03-23T23:58:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f000b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f000b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43994/0 (socket says 172.21.15.31:43994) 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 -- 172.21.15.31:0/3097310326 learned_addr learned my addr 172.21.15.31:0/3097310326 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 -- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0014e640 msgr2=0x7f5f001e0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5effe00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f000b89d0 0x7f5f0006eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f0014e640 0x7f5f001e0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 -- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f000b89d0 msgr2=0x7f5f0006eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f000b89d0 0x7f5f0006eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5f04a00640 1 -- 172.21.15.31:0/3097310326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000b53f0 con 0x7f5f000ade70 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.685+0000 7f5effe00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f000b89d0 0x7f5f0006eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.686+0000 7f5f04a00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f000b1d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ef402b8c0 tx=0x7f5ef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.686+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4032880 con 0x7f5f000ade70 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.686+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef4032a20 con 0x7f5f000ade70 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.686+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0006f650 con 0x7f5f000ade70 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.686+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4032e10 con 0x7f5f000ade70 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.686+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0006f080 con 0x7f5f000ade70 2024-03-23T23:58:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.687+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f000752c0 con 0x7f5f000ade70 2024-03-23T23:58:30.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.689+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5ef404c060 con 0x7f5f000ade70 2024-03-23T23:58:30.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.690+0000 7f5efcc00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5ee006bc50 0x7f5ee006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.690+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f5ef40ac780 con 0x7f5f000ade70 2024-03-23T23:58:30.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.690+0000 7f5efcc00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7f5ee00740b0 0x7f5ee0076530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.690+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 --> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ef4039e50 con 0x7f5ee00740b0 2024-03-23T23:58:30.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.690+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ef40b3050 con 0x7f5f000ade70 2024-03-23T23:58:30.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.690+0000 7f5effe00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5ee006bc50 0x7f5ee006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.690+0000 7f5f05400640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7f5ee00740b0 0x7f5ee0076530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.691+0000 7f5f05400640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7f5ee00740b0 0x7f5ee0076530 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.692+0000 7f5effe00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5ee006bc50 0x7f5ee006e110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5f00145500 tx=0x7f5eec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.694+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== osd.6 v2:172.21.15.59:6816/807447559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5ef4039e50 con 0x7f5ee00740b0 2024-03-23T23:58:30.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.709+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 --> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f0009cc80 con 0x7f5ee00740b0 2024-03-23T23:58:30.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.710+0000 7f5efcc00640 1 -- 172.21.15.31:0/3097310326 <== osd.6 v2:172.21.15.59:6816/807447559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5f0009cc80 con 0x7f5ee00740b0 2024-03-23T23:58:30.710 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:30.710 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:30.710 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:30.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.710+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7f5ee00740b0 msgr2=0x7f5ee0076530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.710+0000 7f5f05e00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6816/807447559,v1:172.21.15.59:6818/807447559] conn(0x7f5ee00740b0 0x7f5ee0076530 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5ee006bc50 msgr2=0x7f5ee006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f5ee006bc50 0x7f5ee006e110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5f00145500 tx=0x7f5eec009040 comp rx=0 tx=0).stop 2024-03-23T23:58:30.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 msgr2=0x7f5f000b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 --2- 172.21.15.31:0/3097310326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f000ade70 0x7f5f000b1d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5ef402b8c0 tx=0x7f5ef40046c0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05400640 1 -- 172.21.15.31:0/3097310326 reap_dead start 2024-03-23T23:58:30.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 shutdown_connections 2024-03-23T23:58:30.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 >> 172.21.15.31:0/3097310326 conn(0x7f5f0006b990 msgr2=0x7f5f000b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 shutdown_connections 2024-03-23T23:58:30.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.711+0000 7f5f05e00640 1 -- 172.21.15.31:0/3097310326 wait complete. 2024-03-23T23:58:30.730 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-23T23:58:30.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.951+0000 7f9585c00640 1 Processor -- start 2024-03-23T23:58:30.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.951+0000 7f9585c00640 1 -- start start 2024-03-23T23:58:30.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.952+0000 7f9585c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9580072a60 0x7f958013ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f9585c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9580071830 con 0x7f9580071450 2024-03-23T23:58:30.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f9585c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95801451d0 con 0x7f958013f4d0 2024-03-23T23:58:30.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f9585c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9580145540 con 0x7f9580072a60 2024-03-23T23:58:30.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f957ea00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9580071450 0x7f95801459d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56868/0 (socket says 172.21.15.31:56868) 2024-03-23T23:58:30.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f957ea00640 1 -- 172.21.15.31:0/2235562746 learned_addr learned my addr 172.21.15.31:0/2235562746 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f9576000640 1 --2- 172.21.15.31:0/2235562746 >> v2:172.21.15.59:3300/0 conn(0x7f9580072a60 0x7f958013ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125124931 0 0) 0x7f9580071830 con 0x7f9580071450 2024-03-23T23:58:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.953+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9564003520 con 0x7f9580071450 2024-03-23T23:58:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907597532 0 0) 0x7f9564003520 con 0x7f9580071450 2024-03-23T23:58:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 >> v2:172.21.15.59:3300/0 conn(0x7f9580072a60 msgr2=0x7f958013ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 --2- 172.21.15.31:0/2235562746 >> v2:172.21.15.59:3300/0 conn(0x7f9580072a60 0x7f958013ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 >> v1:172.21.15.59:6789/0 conn(0x7f958013f4d0 legacy=0x7f958014f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580073550 con 0x7f9580071450 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f95700019f0 con 0x7f9580071450 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f9576000640 1 --2- 172.21.15.31:0/2235562746 >> v2:172.21.15.59:3300/0 conn(0x7f9580072a60 0x7f958013ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 >> v1:172.21.15.31:6789/0 conn(0x7f9580071450 legacy=0x7f95801459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95640039b0 0x7f9564003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9564004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95640052e0 0x7f956400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9580145540 con 0x7f9564004800 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956400c230 con 0x7f95640039b0 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956400c430 con 0x7f95640052e0 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.954+0000 7f9576000640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9564004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.955+0000 7f9576000640 1 -- 172.21.15.31:0/2235562746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95640052e0 msgr2=0x7f956400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.955+0000 7f9576000640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95640052e0 0x7f956400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.955+0000 7f957ea00640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95640039b0 0x7f9564003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.955+0000 7f9576000640 1 -- 172.21.15.31:0/2235562746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95640039b0 msgr2=0x7f9564003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.955+0000 7f9576000640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95640039b0 0x7f9564003db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.955+0000 7f957f400640 1 -- 172.21.15.31:0/2235562746 reap_dead start 2024-03-23T23:58:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.955+0000 7f9576000640 1 -- 172.21.15.31:0/2235562746 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9564003520 con 0x7f9564004800 2024-03-23T23:58:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.956+0000 7f9576000640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9564004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9568006fd0 tx=0x7f9564005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1419cac90239cf5f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.956+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800f040 con 0x7f9564004800 2024-03-23T23:58:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.956+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568004030 con 0x7f9564004800 2024-03-23T23:58:30.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.956+0000 7f957e000640 1 -- 172.21.15.31:0/2235562746 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568004440 con 0x7f9564004800 2024-03-23T23:58:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.957+0000 7f9585c00640 1 -- 172.21.15.31:0/2235562746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 msgr2=0x7f9564004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.957+0000 7f9585c00640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9564004c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9568006fd0 tx=0x7f9564005830 comp rx=0 tx=0).stop 2024-03-23T23:58:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.957+0000 7f9585c00640 1 -- 172.21.15.31:0/2235562746 shutdown_connections 2024-03-23T23:58:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.957+0000 7f9585c00640 1 --2- 172.21.15.31:0/2235562746 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9564004c80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.957+0000 7f9585c00640 1 -- 172.21.15.31:0/2235562746 >> 172.21.15.31:0/2235562746 conn(0x7f95800675c0 msgr2=0x7f95800baa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:30.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.957+0000 7f9585c00640 1 -- 172.21.15.31:0/2235562746 shutdown_connections 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.957+0000 7f9585c00640 1 -- 172.21.15.31:0/2235562746 wait complete. 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.958+0000 7f9585c00640 1 Processor -- start 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.958+0000 7f9585c00640 1 -- start start 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.959+0000 7f9585c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9580139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.959+0000 7f9585c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95801e0210 0x7f95801e0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.959+0000 7f9585c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9580137b60 0x7f9580137fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.959+0000 7f9585c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800b55f0 con 0x7f9564004800 2024-03-23T23:58:30.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.959+0000 7f9585c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95800b5470 con 0x7f95801e0210 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.959+0000 7f9585c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9580073010 con 0x7f9580137b60 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9580139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9580139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44008/0 (socket says 172.21.15.31:44008) 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 -- 172.21.15.31:0/3675906307 learned_addr learned my addr 172.21.15.31:0/3675906307 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f9576000640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95801e0210 0x7f95801e0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957f400640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9580137b60 0x7f9580137fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 -- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9580137b60 msgr2=0x7f9580137fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9580137b60 0x7f9580137fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 -- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95801e0210 msgr2=0x7f95801e0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95801e0210 0x7f95801e0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 -- 172.21.15.31:0/3675906307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95801d01a0 con 0x7f9564004800 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f9576000640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95801e0210 0x7f95801e0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.960+0000 7f957ea00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9580139180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9570002040 tx=0x7f957000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.961+0000 7f9577400640 1 -- 172.21.15.31:0/3675906307 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570019070 con 0x7f9564004800 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.961+0000 7f9577400640 1 -- 172.21.15.31:0/3675906307 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9570004d60 con 0x7f9564004800 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.961+0000 7f9577400640 1 -- 172.21.15.31:0/3675906307 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700072f0 con 0x7f9564004800 2024-03-23T23:58:30.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.961+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95801d06f0 con 0x7f9564004800 2024-03-23T23:58:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.961+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958013aac0 con 0x7f9564004800 2024-03-23T23:58:30.966 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.962+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95801445e0 con 0x7f9564004800 2024-03-23T23:58:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.963+0000 7f9577400640 1 -- 172.21.15.31:0/3675906307 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f957001c070 con 0x7f9564004800 2024-03-23T23:58:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.964+0000 7f9577400640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955c06bc00 0x7f955c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.964+0000 7f9577400640 1 -- 172.21.15.31:0/3675906307 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f957008ad60 con 0x7f9564004800 2024-03-23T23:58:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.964+0000 7f9576000640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955c06bc00 0x7f955c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:30.967 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.965+0000 7f9576000640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955c06bc00 0x7f955c06e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9568035000 tx=0x7f956803a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:30.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:30.968+0000 7f9577400640 1 -- 172.21.15.31:0/3675906307 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f95801445e0 con 0x7f9564004800 2024-03-23T23:58:31.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.167+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f95800b1760 con 0x7f955c06bc00 2024-03-23T23:58:31.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.169+0000 7f9577400640 1 -- 172.21.15.31:0/3675906307 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f95800b1760 con 0x7f955c06bc00 2024-03-23T23:58:31.169 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 6 to deep-scrub 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955c06bc00 msgr2=0x7f955c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955c06bc00 0x7f955c06e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9568035000 tx=0x7f956803a040 comp rx=0 tx=0).stop 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 msgr2=0x7f9580139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9580139180 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9570002040 tx=0x7f957000b4a0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 shutdown_connections 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955c06bc00 0x7f955c06e0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95801e0210 0x7f95801e0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9580137b60 0x7f9580137fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 --2- 172.21.15.31:0/3675906307 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9564004800 0x7f9580139180 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 >> 172.21.15.31:0/3675906307 conn(0x7f95800675c0 msgr2=0x7f95800b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 shutdown_connections 2024-03-23T23:58:31.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.172+0000 7f9585c00640 1 -- 172.21.15.31:0/3675906307 wait complete. 2024-03-23T23:58:31.192 INFO:tasks.ceph:Scrubbing osd.7 2024-03-23T23:58:31.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-23T23:58:31.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.426+0000 7f1cb7e00640 1 Processor -- start 2024-03-23T23:58:31.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.427+0000 7f1cb7e00640 1 -- start start 2024-03-23T23:58:31.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cb7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1cb8073290 0x7f1cb8145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cb7e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb80b4a20 con 0x7f1cb809bf50 2024-03-23T23:58:31.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cb7e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb80b8870 con 0x7f1cb8072eb0 2024-03-23T23:58:31.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cb7e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb80b8b50 con 0x7f1cb8073290 2024-03-23T23:58:31.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cafe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1cb8073290 0x7f1cb8145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cafe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1cb8073290 0x7f1cb8145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44020/0 (socket says 172.21.15.31:44020) 2024-03-23T23:58:31.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cb7400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1cb809bf50 0x7f1cb80b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56884/0 (socket says 172.21.15.31:56884) 2024-03-23T23:58:31.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.428+0000 7f1cafe00640 1 -- 172.21.15.31:0/449766011 learned_addr learned my addr 172.21.15.31:0/449766011 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:31.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.429+0000 7f1cafe00640 1 -- 172.21.15.31:0/449766011 >> v1:172.21.15.59:6789/0 conn(0x7f1cb8072eb0 legacy=0x7f1cb809dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.429+0000 7f1cafe00640 1 -- 172.21.15.31:0/449766011 >> v1:172.21.15.31:6789/0 conn(0x7f1cb809bf50 legacy=0x7f1cb80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.429+0000 7f1cafe00640 1 -- 172.21.15.31:0/449766011 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb809d820 con 0x7f1cb8073290 2024-03-23T23:58:31.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.430+0000 7f1cafe00640 1 --2- 172.21.15.31:0/449766011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8073290 0x7f1cb8145120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009870 tx=0x7f1ca002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c6416308c4e8a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.430+0000 7f1cb6000640 1 -- 172.21.15.31:0/449766011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0034070 con 0x7f1cb8073290 2024-03-23T23:58:31.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.430+0000 7f1cb6000640 1 -- 172.21.15.31:0/449766011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca0030860 con 0x7f1cb8073290 2024-03-23T23:58:31.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.430+0000 7f1cb6000640 1 -- 172.21.15.31:0/449766011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0030c30 con 0x7f1cb8073290 2024-03-23T23:58:31.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.431+0000 7f1cb7e00640 1 -- 172.21.15.31:0/449766011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8073290 msgr2=0x7f1cb8145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.431+0000 7f1cb7e00640 1 --2- 172.21.15.31:0/449766011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8073290 0x7f1cb8145120 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009870 tx=0x7f1ca002b9a0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.431+0000 7f1cb7e00640 1 -- 172.21.15.31:0/449766011 shutdown_connections 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.431+0000 7f1cb7e00640 1 --2- 172.21.15.31:0/449766011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8073290 0x7f1cb8145120 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.431+0000 7f1cb7e00640 1 -- 172.21.15.31:0/449766011 >> 172.21.15.31:0/449766011 conn(0x7f1cb806b990 msgr2=0x7f1cb806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.431+0000 7f1cb7e00640 1 -- 172.21.15.31:0/449766011 shutdown_connections 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.431+0000 7f1cb7e00640 1 -- 172.21.15.31:0/449766011 wait complete. 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.433+0000 7f1cb7e00640 1 Processor -- start 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.433+0000 7f1cb7e00640 1 -- start start 2024-03-23T23:58:31.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8072eb0 0x7f1cb80b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb8073290 0x7f1cb813fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb7e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb809bf50 0x7f1cb8140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb7e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80b8610 con 0x7f1cb8072eb0 2024-03-23T23:58:31.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80b8490 con 0x7f1cb8073290 2024-03-23T23:58:31.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb7e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb81509d0 con 0x7f1cb809bf50 2024-03-23T23:58:31.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8072eb0 0x7f1cb80b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8072eb0 0x7f1cb80b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44022/0 (socket says 172.21.15.31:44022) 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 -- 172.21.15.31:0/258552582 learned_addr learned my addr 172.21.15.31:0/258552582 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cafe00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb8073290 0x7f1cb813fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb7400640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb809bf50 0x7f1cb8140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 -- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb809bf50 msgr2=0x7f1cb8140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb809bf50 0x7f1cb8140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 -- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb8073290 msgr2=0x7f1cb813fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb8073290 0x7f1cb813fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cb6a00640 1 -- 172.21.15.31:0/258552582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb813b650 con 0x7f1cb8072eb0 2024-03-23T23:58:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.434+0000 7f1cafe00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb8073290 0x7f1cb813fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.435+0000 7f1cb6a00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8072eb0 0x7f1cb80b15d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800c450 tx=0x7f1ca800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.435+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80052d0 con 0x7f1cb8072eb0 2024-03-23T23:58:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.435+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca8005470 con 0x7f1cb8072eb0 2024-03-23T23:58:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.435+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8012870 con 0x7f1cb8072eb0 2024-03-23T23:58:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.435+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb80b2260 con 0x7f1cb8072eb0 2024-03-23T23:58:31.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.435+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb81425c0 con 0x7f1cb8072eb0 2024-03-23T23:58:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.436+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1cb80752c0 con 0x7f1cb8072eb0 2024-03-23T23:58:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.438+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1ca8012a10 con 0x7f1cb8072eb0 2024-03-23T23:58:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.439+0000 7f1caea00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1c9406bbd0 0x7f1c9406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.439+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f1ca808a7d0 con 0x7f1cb8072eb0 2024-03-23T23:58:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.439+0000 7f1caea00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7f1c94073fa0 0x7f1c94076420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.439+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c94076af0 con 0x7f1c94073fa0 2024-03-23T23:58:31.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.439+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ca8091050 con 0x7f1cb8072eb0 2024-03-23T23:58:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.439+0000 7f1cafe00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1c9406bbd0 0x7f1c9406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.440+0000 7f1cb7400640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7f1c94073fa0 0x7f1c94076420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.441+0000 7f1cafe00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1c9406bbd0 0x7f1c9406e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0036000 tx=0x7f1ca003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.441+0000 7f1cb7400640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7f1c94073fa0 0x7f1c94076420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.443+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== osd.7 v2:172.21.15.59:6808/1396029038 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1c94076af0 con 0x7f1c94073fa0 2024-03-23T23:58:31.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.459+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 --> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1cb8139ce0 con 0x7f1c94073fa0 2024-03-23T23:58:31.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.460+0000 7f1caea00640 1 -- 172.21.15.31:0/258552582 <== osd.7 v2:172.21.15.59:6808/1396029038 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1cb8139ce0 con 0x7f1c94073fa0 2024-03-23T23:58:31.460 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-03-23T23:58:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T23:58:31.461 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-03-23T23:58:31.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7f1c94073fa0 msgr2=0x7f1c94076420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6808/1396029038,v1:172.21.15.59:6809/1396029038] conn(0x7f1c94073fa0 0x7f1c94076420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1c9406bbd0 msgr2=0x7f1c9406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f1c9406bbd0 0x7f1c9406e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0036000 tx=0x7f1ca003b040 comp rx=0 tx=0).stop 2024-03-23T23:58:31.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8072eb0 msgr2=0x7f1cb80b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 --2- 172.21.15.31:0/258552582 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1cb8072eb0 0x7f1cb80b15d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800c450 tx=0x7f1ca800c910 comp rx=0 tx=0).stop 2024-03-23T23:58:31.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7400640 1 -- 172.21.15.31:0/258552582 reap_dead start 2024-03-23T23:58:31.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 shutdown_connections 2024-03-23T23:58:31.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 >> 172.21.15.31:0/258552582 conn(0x7f1cb806b990 msgr2=0x7f1cb8068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 shutdown_connections 2024-03-23T23:58:31.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.461+0000 7f1cb7e00640 1 -- 172.21.15.31:0/258552582 wait complete. 2024-03-23T23:58:31.480 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-23T23:58:31.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.707+0000 7f3c2ae00640 1 Processor -- start 2024-03-23T23:58:31.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.707+0000 7f3c2ae00640 1 -- start start 2024-03-23T23:58:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.708+0000 7f3c2ae00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c240b88b0 0x7f3c240b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.708+0000 7f3c2ae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c24142380 0x7f3c241427c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.708+0000 7f3c2ae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240b8c90 con 0x7f3c24148950 2024-03-23T23:58:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.708+0000 7f3c2ae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240b4f60 con 0x7f3c24142380 2024-03-23T23:58:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.708+0000 7f3c2ae00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240b49a0 con 0x7f3c240b88b0 2024-03-23T23:58:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c240b88b0 0x7f3c240b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c24142380 0x7f3c241427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c240b88b0 0x7f3c240b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60138/0 (socket says 172.21.15.31:60138) 2024-03-23T23:58:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29a00640 1 -- 172.21.15.31:0/1244330256 learned_addr learned my addr 172.21.15.31:0/1244330256 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c24142380 0x7f3c241427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:56718/0 (socket says 172.21.15.31:56718) 2024-03-23T23:58:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29a00640 1 -- 172.21.15.31:0/1244330256 >> v2:172.21.15.59:3300/0 conn(0x7f3c24142380 msgr2=0x7f3c241427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29a00640 1 --2- 172.21.15.31:0/1244330256 >> v2:172.21.15.59:3300/0 conn(0x7f3c24142380 0x7f3c241427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29a00640 1 -- 172.21.15.31:0/1244330256 >> v1:172.21.15.59:6789/0 conn(0x7f3c24148950 legacy=0x7f3c24148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.709+0000 7f3c29a00640 1 -- 172.21.15.31:0/1244330256 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240b4c80 con 0x7f3c240b88b0 2024-03-23T23:58:31.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.710+0000 7f3c29000640 1 --2- 172.21.15.31:0/1244330256 >> v2:172.21.15.59:3300/0 conn(0x7f3c24142380 0x7f3c241427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:58:31.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.711+0000 7f3c29a00640 1 --2- 172.21.15.31:0/1244330256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c240b88b0 0x7f3c240b4160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009870 tx=0x7f3c1802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf421fbc1f78e3c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c23e00640 1 -- 172.21.15.31:0/1244330256 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18035020 con 0x7f3c240b88b0 2024-03-23T23:58:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c23e00640 1 -- 172.21.15.31:0/1244330256 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c18031640 con 0x7f3c240b88b0 2024-03-23T23:58:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c23e00640 1 -- 172.21.15.31:0/1244330256 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1802d040 con 0x7f3c240b88b0 2024-03-23T23:58:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 -- 172.21.15.31:0/1244330256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c240b88b0 msgr2=0x7f3c240b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/1244330256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c240b88b0 0x7f3c240b4160 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009870 tx=0x7f3c1802b8f0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 -- 172.21.15.31:0/1244330256 shutdown_connections 2024-03-23T23:58:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/1244330256 >> v2:172.21.15.59:3300/0 conn(0x7f3c24142380 0x7f3c241427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/1244330256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c240b88b0 0x7f3c240b4160 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 -- 172.21.15.31:0/1244330256 >> 172.21.15.31:0/1244330256 conn(0x7f3c2406cf40 msgr2=0x7f3c2406ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 -- 172.21.15.31:0/1244330256 shutdown_connections 2024-03-23T23:58:31.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.712+0000 7f3c2ae00640 1 -- 172.21.15.31:0/1244330256 wait complete. 2024-03-23T23:58:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.714+0000 7f3c2ae00640 1 Processor -- start 2024-03-23T23:58:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.714+0000 7f3c2ae00640 1 -- start start 2024-03-23T23:58:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c2ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c240b88b0 0x7f3c241cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c2ae00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c24142380 0x7f3c240aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c2ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c24148950 0x7f3c241cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c2ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240b9490 con 0x7f3c240b88b0 2024-03-23T23:58:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c2ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240b46a0 con 0x7f3c24148950 2024-03-23T23:58:31.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c2ae00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240aea90 con 0x7f3c24142380 2024-03-23T23:58:31.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c240b88b0 0x7f3c241cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c240b88b0 0x7f3c241cfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44038/0 (socket says 172.21.15.31:44038) 2024-03-23T23:58:31.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c29a00640 1 -- 172.21.15.31:0/3104949881 learned_addr learned my addr 172.21.15.31:0/3104949881 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:31.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c29000640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c24142380 0x7f3c240aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.715+0000 7f3c2a400640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c24148950 0x7f3c241cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c29a00640 1 -- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c24142380 msgr2=0x7f3c240aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c29a00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c24142380 0x7f3c240aef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c29a00640 1 -- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c24148950 msgr2=0x7f3c241cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c29a00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c24148950 0x7f3c241cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c29a00640 1 -- 172.21.15.31:0/3104949881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c241cf430 con 0x7f3c240b88b0 2024-03-23T23:58:31.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c29000640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c24142380 0x7f3c240aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:31.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c2a400640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c24148950 0x7f3c241cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:31.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c29a00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c240b88b0 0x7f3c241cfea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c1802b930 tx=0x7f3c180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c21600640 1 -- 172.21.15.31:0/3104949881 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18040070 con 0x7f3c240b88b0 2024-03-23T23:58:31.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c21600640 1 -- 172.21.15.31:0/3104949881 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1803e070 con 0x7f3c240b88b0 2024-03-23T23:58:31.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c241ce4d0 con 0x7f3c240b88b0 2024-03-23T23:58:31.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c21600640 1 -- 172.21.15.31:0/3104949881 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c18035040 con 0x7f3c240b88b0 2024-03-23T23:58:31.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.716+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240af460 con 0x7f3c240b88b0 2024-03-23T23:58:31.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.718+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c240ae890 con 0x7f3c240b88b0 2024-03-23T23:58:31.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.719+0000 7f3c21600640 1 -- 172.21.15.31:0/3104949881 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3c18038020 con 0x7f3c240b88b0 2024-03-23T23:58:31.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.719+0000 7f3c21600640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c0406bbd0 0x7f3c0406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:31.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.719+0000 7f3c21600640 1 -- 172.21.15.31:0/3104949881 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f3c180ac430 con 0x7f3c240b88b0 2024-03-23T23:58:31.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.720+0000 7f3c29000640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c0406bbd0 0x7f3c0406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:31.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.721+0000 7f3c29000640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c0406bbd0 0x7f3c0406e090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c241d13c0 tx=0x7f3c10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:31.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.724+0000 7f3c21600640 1 -- 172.21.15.31:0/3104949881 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f3c1807af10 con 0x7f3c240b88b0 2024-03-23T23:58:31.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.926+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c241ce6a0 con 0x7f3c0406bbd0 2024-03-23T23:58:31.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.928+0000 7f3c21600640 1 -- 172.21.15.31:0/3104949881 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c10010900 con 0x7f3c0406bbd0 2024-03-23T23:58:31.928 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 7 to deep-scrub 2024-03-23T23:58:31.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c0406bbd0 msgr2=0x7f3c0406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c0406bbd0 0x7f3c0406e090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3c241d13c0 tx=0x7f3c10008040 comp rx=0 tx=0).stop 2024-03-23T23:58:31.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c240b88b0 msgr2=0x7f3c241cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c240b88b0 0x7f3c241cfea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3c1802b930 tx=0x7f3c180046c0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 shutdown_connections 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f3c0406bbd0 0x7f3c0406e090 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c24148950 0x7f3c241cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c24142380 0x7f3c240aef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 --2- 172.21.15.31:0/3104949881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c240b88b0 0x7f3c241cfea0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 >> 172.21.15.31:0/3104949881 conn(0x7f3c2406cf40 msgr2=0x7f3c240b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 shutdown_connections 2024-03-23T23:58:31.931 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:31.930+0000 7f3c2ae00640 1 -- 172.21.15.31:0/3104949881 wait complete. 2024-03-23T23:58:31.951 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:32.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.164+0000 7fcdb6c00640 1 Processor -- start 2024-03-23T23:58:32.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.164+0000 7fcdb6c00640 1 -- start start 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.165+0000 7fcdb6c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcdb00b58f0 0x7fcdb0148810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.165+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00727e0 0x7fcdb014fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.165+0000 7fcdb6c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb00b46d0 con 0x7fcdb00b5510 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdb6c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb006f420 con 0x7fcdb00b58f0 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00b49b0 con 0x7fcdb00727e0 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdafe00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcdb00b5510 0x7fcdb0071d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56886/0 (socket says 172.21.15.31:56886) 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdafe00640 1 -- 172.21.15.31:0/1461881781 learned_addr learned my addr 172.21.15.31:0/1461881781 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdaf400640 1 --2- 172.21.15.31:0/1461881781 >> v2:172.21.15.31:3300/0 conn(0x7fcdb00b58f0 0x7fcdb0148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdb4c00640 1 --2- 172.21.15.31:0/1461881781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00727e0 0x7fcdb014fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdaea00640 1 -- 172.21.15.31:0/1461881781 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377424132 0 0) 0x7fcdb00b46d0 con 0x7fcdb00b5510 2024-03-23T23:58:32.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdaea00640 1 -- 172.21.15.31:0/1461881781 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd94003520 con 0x7fcdb00b5510 2024-03-23T23:58:32.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdaf400640 1 -- 172.21.15.31:0/1461881781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00727e0 msgr2=0x7fcdb014fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:32.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdaf400640 1 --2- 172.21.15.31:0/1461881781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00727e0 0x7fcdb014fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.166+0000 7fcdaf400640 1 -- 172.21.15.31:0/1461881781 >> v1:172.21.15.31:6789/0 conn(0x7fcdb00b5510 legacy=0x7fcdb0071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.167+0000 7fcdaf400640 1 -- 172.21.15.31:0/1461881781 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00b2620 con 0x7fcdb00b58f0 2024-03-23T23:58:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.168+0000 7fcdaf400640 1 --2- 172.21.15.31:0/1461881781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b58f0 0x7fcdb0148810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0097a0 tx=0x7fcd9c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b868309c9f9568 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:32.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.168+0000 7fcdaea00640 1 -- 172.21.15.31:0/1461881781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c038070 con 0x7fcdb00b58f0 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdaea00640 1 -- 172.21.15.31:0/1461881781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c031700 con 0x7fcdb00b58f0 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdaea00640 1 -- 172.21.15.31:0/1461881781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c031ad0 con 0x7fcdb00b58f0 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1461881781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b58f0 msgr2=0x7fcdb0148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1461881781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b58f0 0x7fcdb0148810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0097a0 tx=0x7fcd9c02b7a0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1461881781 shutdown_connections 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1461881781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00727e0 0x7fcdb014fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1461881781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b58f0 0x7fcdb0148810 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1461881781 >> 172.21.15.31:0/1461881781 conn(0x7fcdb0066fe0 msgr2=0x7fcdb00673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1461881781 shutdown_connections 2024-03-23T23:58:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.169+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1461881781 wait complete. 2024-03-23T23:58:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.171+0000 7fcdb6c00640 1 Processor -- start 2024-03-23T23:58:32.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.171+0000 7fcdb6c00640 1 -- start start 2024-03-23T23:58:32.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb00727e0 0x7fcdb01389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b5510 0x7fcdb0145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00b58f0 0x7fcdb0140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00b5050 con 0x7fcdb00b5510 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00b4ed0 con 0x7fcdb00727e0 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb006ee70 con 0x7fcdb00b58f0 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdaf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b5510 0x7fcdb0145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdaf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b5510 0x7fcdb0145c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44064/0 (socket says 172.21.15.31:44064) 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.172+0000 7fcdaf400640 1 -- 172.21.15.31:0/1834631256 learned_addr learned my addr 172.21.15.31:0/1834631256 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:32.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdafe00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb00727e0 0x7fcdb01389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdb4c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00b58f0 0x7fcdb0140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdaf400640 1 -- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00b58f0 msgr2=0x7fcdb0140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdaf400640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00b58f0 0x7fcdb0140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdaf400640 1 -- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb00727e0 msgr2=0x7fcdb01389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdaf400640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb00727e0 0x7fcdb01389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdaf400640 1 -- 172.21.15.31:0/1834631256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb014fc20 con 0x7fcdb00b5510 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdb4c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00b58f0 0x7fcdb0140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:58:32.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.173+0000 7fcdaf400640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b5510 0x7fcdb0145c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000c00 tx=0x7fcd9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:32.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.174+0000 7fcda7e00640 1 -- 172.21.15.31:0/1834631256 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c042070 con 0x7fcdb00b5510 2024-03-23T23:58:32.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.174+0000 7fcda7e00640 1 -- 172.21.15.31:0/1834631256 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c03d870 con 0x7fcdb00b5510 2024-03-23T23:58:32.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.174+0000 7fcda7e00640 1 -- 172.21.15.31:0/1834631256 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c038040 con 0x7fcdb00b5510 2024-03-23T23:58:32.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.174+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb013fde0 con 0x7fcdb00b5510 2024-03-23T23:58:32.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.174+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb0140c50 con 0x7fcdb00b5510 2024-03-23T23:58:32.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.175+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb004f400 con 0x7fcdb00b5510 2024-03-23T23:58:32.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.176+0000 7fcda7e00640 1 -- 172.21.15.31:0/1834631256 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcd9c045070 con 0x7fcdb00b5510 2024-03-23T23:58:32.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.177+0000 7fcda7e00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcd9006bbd0 0x7fcd9006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:32.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.177+0000 7fcda7e00640 1 -- 172.21.15.31:0/1834631256 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7fcd9c0ac6e0 con 0x7fcdb00b5510 2024-03-23T23:58:32.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.177+0000 7fcdafe00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcd9006bbd0 0x7fcd9006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:32.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.179+0000 7fcdafe00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcd9006bbd0 0x7fcd9006e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcda0005c00 tx=0x7fcda0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:32.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.181+0000 7fcda7e00640 1 -- 172.21.15.31:0/1834631256 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fcd9c030070 con 0x7fcdb00b5510 2024-03-23T23:58:32.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.377+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcdb01411b0 con 0x7fcd9006bbd0 2024-03-23T23:58:32.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.398+0000 7fcda7e00640 1 -- 172.21.15.31:0/1834631256 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251172 (secure 0 0 0) 0x7fcdb01411b0 con 0x7fcd9006bbd0 2024-03-23T23:58:32.400 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:58:32.403 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:58:32.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcd9006bbd0 msgr2=0x7fcd9006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcd9006bbd0 0x7fcd9006e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcda0005c00 tx=0x7fcda0009040 comp rx=0 tx=0).stop 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b5510 msgr2=0x7fcdb0145c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b5510 0x7fcdb0145c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000c00 tx=0x7fcd9c0046c0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 shutdown_connections 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fcd9006bbd0 0x7fcd9006e090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcdb00b58f0 0x7fcdb0140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcdb00b5510 0x7fcdb0145c80 secure :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c000c00 tx=0x7fcd9c0046c0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 --2- 172.21.15.31:0/1834631256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb00727e0 0x7fcdb01389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:32.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 >> 172.21.15.31:0/1834631256 conn(0x7fcdb0066fe0 msgr2=0x7fcdb0071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.404+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 shutdown_connections 2024-03-23T23:58:32.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:32.405+0000 7fcdb6c00640 1 -- 172.21.15.31:0/1834631256 wait complete. 2024-03-23T23:58:32.425 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-03-23T23:58:31.373473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":737812,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":125,"num_read_kb":109,"num_write":356,"num_write_kb":2663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1328,"ondisk_log_size":1328,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3552,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3637248,"data_stored":2226808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":79162,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":69,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.014104"},"pg_stats":[{"pgid":"3.3f","version":"24'15","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.677253+0000","last_change":"2024-03-23T23:56:30.885878+0000","last_active":"2024-03-23T23:58:21.677253+0000","last_peered":"2024-03-23T23:58:21.677253+0000","last_clean":"2024-03-23T23:58:21.677253+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:58:21.677253+0000","last_undegraded":"2024-03-23T23:58:21.677253+0000","last_fullsized":"2024-03-23T23:58:21.677253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.673242+0000","last_change":"2024-03-23T23:56:30.875303+0000","last_active":"2024-03-23T23:58:21.673242+0000","last_peered":"2024-03-23T23:58:21.673242+0000","last_clean":"2024-03-23T23:58:21.673242+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:58:21.673242+0000","last_undegraded":"2024-03-23T23:58:21.673242+0000","last_fullsized":"2024-03-23T23:58:21.673242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'15","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.675397+0000","last_change":"2024-03-23T23:56:30.883893+0000","last_active":"2024-03-23T23:58:21.675397+0000","last_peered":"2024-03-23T23:58:21.675397+0000","last_clean":"2024-03-23T23:58:21.675397+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:58:21.675397+0000","last_undegraded":"2024-03-23T23:58:21.675397+0000","last_fullsized":"2024-03-23T23:58:21.675397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'12","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.686731+0000","last_change":"2024-03-23T23:56:30.891008+0000","last_active":"2024-03-23T23:58:21.686731+0000","last_peered":"2024-03-23T23:58:21.686731+0000","last_clean":"2024-03-23T23:58:21.686731+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:58:21.686731+0000","last_undegraded":"2024-03-23T23:58:21.686731+0000","last_fullsized":"2024-03-23T23:58:21.686731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'15","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.680679+0000","last_change":"2024-03-23T23:56:30.877242+0000","last_active":"2024-03-23T23:58:21.680679+0000","last_peered":"2024-03-23T23:58:21.680679+0000","last_clean":"2024-03-23T23:58:21.680679+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:58:21.680679+0000","last_undegraded":"2024-03-23T23:58:21.680679+0000","last_fullsized":"2024-03-23T23:58:21.680679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'10","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.680867+0000","last_change":"2024-03-23T23:56:30.890268+0000","last_active":"2024-03-23T23:58:21.680867+0000","last_peered":"2024-03-23T23:58:21.680867+0000","last_clean":"2024-03-23T23:58:21.680867+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:58:21.680867+0000","last_undegraded":"2024-03-23T23:58:21.680867+0000","last_fullsized":"2024-03-23T23:58:21.680867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'11","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.686234+0000","last_change":"2024-03-23T23:56:30.885059+0000","last_active":"2024-03-23T23:58:21.686234+0000","last_peered":"2024-03-23T23:58:21.686234+0000","last_clean":"2024-03-23T23:58:21.686234+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:58:21.686234+0000","last_undegraded":"2024-03-23T23:58:21.686234+0000","last_fullsized":"2024-03-23T23:58:21.686234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:42.547398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'10","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.599660+0000","last_change":"2024-03-23T23:56:30.881077+0000","last_active":"2024-03-23T23:58:21.599660+0000","last_peered":"2024-03-23T23:58:21.599660+0000","last_clean":"2024-03-23T23:58:21.599660+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:58:21.599660+0000","last_undegraded":"2024-03-23T23:58:21.599660+0000","last_fullsized":"2024-03-23T23:58:21.599660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:11.951594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.691451+0000","last_change":"2024-03-23T23:56:30.883587+0000","last_active":"2024-03-23T23:58:21.691451+0000","last_peered":"2024-03-23T23:58:21.691451+0000","last_clean":"2024-03-23T23:58:21.691451+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:58:21.691451+0000","last_undegraded":"2024-03-23T23:58:21.691451+0000","last_fullsized":"2024-03-23T23:58:21.691451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'26","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.684102+0000","last_change":"2024-03-23T23:56:30.888454+0000","last_active":"2024-03-23T23:58:21.684102+0000","last_peered":"2024-03-23T23:58:21.684102+0000","last_clean":"2024-03-23T23:58:21.684102+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:58:21.684102+0000","last_undegraded":"2024-03-23T23:58:21.684102+0000","last_fullsized":"2024-03-23T23:58:21.684102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'14","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.685270+0000","last_change":"2024-03-23T23:56:30.881125+0000","last_active":"2024-03-23T23:58:21.685270+0000","last_peered":"2024-03-23T23:58:21.685270+0000","last_clean":"2024-03-23T23:58:21.685270+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:58:21.685270+0000","last_undegraded":"2024-03-23T23:58:21.685270+0000","last_fullsized":"2024-03-23T23:58:21.685270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'12","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.668288+0000","last_change":"2024-03-23T23:56:30.863287+0000","last_active":"2024-03-23T23:58:21.668288+0000","last_peered":"2024-03-23T23:58:21.668288+0000","last_clean":"2024-03-23T23:58:21.668288+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:58:21.668288+0000","last_undegraded":"2024-03-23T23:58:21.668288+0000","last_fullsized":"2024-03-23T23:58:21.668288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:22:00.178139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.674507+0000","last_change":"2024-03-23T23:56:30.881169+0000","last_active":"2024-03-23T23:58:21.674507+0000","last_peered":"2024-03-23T23:58:21.674507+0000","last_clean":"2024-03-23T23:58:21.674507+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:58:21.674507+0000","last_undegraded":"2024-03-23T23:58:21.674507+0000","last_fullsized":"2024-03-23T23:58:21.674507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'20","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.678648+0000","last_change":"2024-03-23T23:56:30.876653+0000","last_active":"2024-03-23T23:58:21.678648+0000","last_peered":"2024-03-23T23:58:21.678648+0000","last_clean":"2024-03-23T23:58:21.678648+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:58:21.678648+0000","last_undegraded":"2024-03-23T23:58:21.678648+0000","last_fullsized":"2024-03-23T23:58:21.678648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'17","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.661379+0000","last_change":"2024-03-23T23:56:30.862687+0000","last_active":"2024-03-23T23:58:21.661379+0000","last_peered":"2024-03-23T23:58:21.661379+0000","last_clean":"2024-03-23T23:58:21.661379+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:58:21.661379+0000","last_undegraded":"2024-03-23T23:58:21.661379+0000","last_fullsized":"2024-03-23T23:58:21.661379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'21","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.684984+0000","last_change":"2024-03-23T23:56:30.882976+0000","last_active":"2024-03-23T23:58:21.684984+0000","last_peered":"2024-03-23T23:58:21.684984+0000","last_clean":"2024-03-23T23:58:21.684984+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:58:21.684984+0000","last_undegraded":"2024-03-23T23:58:21.684984+0000","last_fullsized":"2024-03-23T23:58:21.684984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'16","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.687127+0000","last_change":"2024-03-23T23:56:30.895060+0000","last_active":"2024-03-23T23:58:21.687127+0000","last_peered":"2024-03-23T23:58:21.687127+0000","last_clean":"2024-03-23T23:58:21.687127+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:58:21.687127+0000","last_undegraded":"2024-03-23T23:58:21.687127+0000","last_fullsized":"2024-03-23T23:58:21.687127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:30:09.925912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'26","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.665579+0000","last_change":"2024-03-23T23:56:30.892332+0000","last_active":"2024-03-23T23:58:21.665579+0000","last_peered":"2024-03-23T23:58:21.665579+0000","last_clean":"2024-03-23T23:58:21.665579+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:58:21.665579+0000","last_undegraded":"2024-03-23T23:58:21.665579+0000","last_fullsized":"2024-03-23T23:58:21.665579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'15","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.684276+0000","last_change":"2024-03-23T23:56:30.881290+0000","last_active":"2024-03-23T23:58:21.684276+0000","last_peered":"2024-03-23T23:58:21.684276+0000","last_clean":"2024-03-23T23:58:21.684276+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:58:21.684276+0000","last_undegraded":"2024-03-23T23:58:21.684276+0000","last_fullsized":"2024-03-23T23:58:21.684276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:54:18.265054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.687207+0000","last_change":"2024-03-23T23:56:30.875425+0000","last_active":"2024-03-23T23:58:21.687207+0000","last_peered":"2024-03-23T23:58:21.687207+0000","last_clean":"2024-03-23T23:58:21.687207+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:58:21.687207+0000","last_undegraded":"2024-03-23T23:58:21.687207+0000","last_fullsized":"2024-03-23T23:58:21.687207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'20","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.685840+0000","last_change":"2024-03-23T23:56:30.884434+0000","last_active":"2024-03-23T23:58:21.685840+0000","last_peered":"2024-03-23T23:58:21.685840+0000","last_clean":"2024-03-23T23:58:21.685840+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:58:21.685840+0000","last_undegraded":"2024-03-23T23:58:21.685840+0000","last_fullsized":"2024-03-23T23:58:21.685840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'19","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.680184+0000","last_change":"2024-03-23T23:57:11.230601+0000","last_active":"2024-03-23T23:58:21.680184+0000","last_peered":"2024-03-23T23:58:21.680184+0000","last_clean":"2024-03-23T23:58:21.680184+0000","last_became_active":"2024-03-23T23:57:11.229498+0000","last_became_peered":"2024-03-23T23:57:11.229498+0000","last_unstale":"2024-03-23T23:58:21.680184+0000","last_undegraded":"2024-03-23T23:58:21.680184+0000","last_fullsized":"2024-03-23T23:58:21.680184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"24'19","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.689541+0000","last_change":"2024-03-23T23:56:30.888046+0000","last_active":"2024-03-23T23:58:21.689541+0000","last_peered":"2024-03-23T23:58:21.689541+0000","last_clean":"2024-03-23T23:58:21.689541+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:58:21.689541+0000","last_undegraded":"2024-03-23T23:58:21.689541+0000","last_fullsized":"2024-03-23T23:58:21.689541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'15","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.683746+0000","last_change":"2024-03-23T23:56:30.886470+0000","last_active":"2024-03-23T23:58:21.683746+0000","last_peered":"2024-03-23T23:58:21.683746+0000","last_clean":"2024-03-23T23:58:21.683746+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:58:21.683746+0000","last_undegraded":"2024-03-23T23:58:21.683746+0000","last_fullsized":"2024-03-23T23:58:21.683746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'11","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.663440+0000","last_change":"2024-03-23T23:56:30.885446+0000","last_active":"2024-03-23T23:58:21.663440+0000","last_peered":"2024-03-23T23:58:21.663440+0000","last_clean":"2024-03-23T23:58:21.663440+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:58:21.663440+0000","last_undegraded":"2024-03-23T23:58:21.663440+0000","last_fullsized":"2024-03-23T23:58:21.663440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:14:38.268305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'23","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.677949+0000","last_change":"2024-03-23T23:56:30.882609+0000","last_active":"2024-03-23T23:58:21.677949+0000","last_peered":"2024-03-23T23:58:21.677949+0000","last_clean":"2024-03-23T23:58:21.677949+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:58:21.677949+0000","last_undegraded":"2024-03-23T23:58:21.677949+0000","last_fullsized":"2024-03-23T23:58:21.677949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'16","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.665935+0000","last_change":"2024-03-23T23:56:30.881031+0000","last_active":"2024-03-23T23:58:21.665935+0000","last_peered":"2024-03-23T23:58:21.665935+0000","last_clean":"2024-03-23T23:58:21.665935+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:58:21.665935+0000","last_undegraded":"2024-03-23T23:58:21.665935+0000","last_fullsized":"2024-03-23T23:58:21.665935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'10","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.663188+0000","last_change":"2024-03-23T23:56:30.887942+0000","last_active":"2024-03-23T23:58:21.663188+0000","last_peered":"2024-03-23T23:58:21.663188+0000","last_clean":"2024-03-23T23:58:21.663188+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:58:21.663188+0000","last_undegraded":"2024-03-23T23:58:21.663188+0000","last_fullsized":"2024-03-23T23:58:21.663188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:46:34.758479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'14","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.676636+0000","last_change":"2024-03-23T23:56:30.882527+0000","last_active":"2024-03-23T23:58:21.676636+0000","last_peered":"2024-03-23T23:58:21.676636+0000","last_clean":"2024-03-23T23:58:21.676636+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:58:21.676636+0000","last_undegraded":"2024-03-23T23:58:21.676636+0000","last_fullsized":"2024-03-23T23:58:21.676636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.687460+0000","last_change":"2024-03-23T23:56:30.885451+0000","last_active":"2024-03-23T23:58:21.687460+0000","last_peered":"2024-03-23T23:58:21.687460+0000","last_clean":"2024-03-23T23:58:21.687460+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:58:21.687460+0000","last_undegraded":"2024-03-23T23:58:21.687460+0000","last_fullsized":"2024-03-23T23:58:21.687460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'19","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.687341+0000","last_change":"2024-03-23T23:56:30.880152+0000","last_active":"2024-03-23T23:58:21.687341+0000","last_peered":"2024-03-23T23:58:21.687341+0000","last_clean":"2024-03-23T23:58:21.687341+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:58:21.687341+0000","last_undegraded":"2024-03-23T23:58:21.687341+0000","last_fullsized":"2024-03-23T23:58:21.687341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.674973+0000","last_change":"2024-03-23T23:56:30.880378+0000","last_active":"2024-03-23T23:58:21.674973+0000","last_peered":"2024-03-23T23:58:21.674973+0000","last_clean":"2024-03-23T23:58:21.674973+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:58:21.674973+0000","last_undegraded":"2024-03-23T23:58:21.674973+0000","last_fullsized":"2024-03-23T23:58:21.674973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:21:07.188733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.667976+0000","last_change":"2024-03-23T23:56:30.869148+0000","last_active":"2024-03-23T23:58:21.667976+0000","last_peered":"2024-03-23T23:58:21.667976+0000","last_clean":"2024-03-23T23:58:21.667976+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:58:21.667976+0000","last_undegraded":"2024-03-23T23:58:21.667976+0000","last_fullsized":"2024-03-23T23:58:21.667976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:38.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578452+0000","last_change":"2024-03-23T23:56:29.890549+0000","last_active":"2024-03-23T23:58:16.578452+0000","last_peered":"2024-03-23T23:58:16.578452+0000","last_clean":"2024-03-23T23:58:16.578452+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:58:16.578452+0000","last_undegraded":"2024-03-23T23:58:16.578452+0000","last_fullsized":"2024-03-23T23:58:16.578452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:40:15.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'17","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.688439+0000","last_change":"2024-03-23T23:56:30.885979+0000","last_active":"2024-03-23T23:58:21.688439+0000","last_peered":"2024-03-23T23:58:21.688439+0000","last_clean":"2024-03-23T23:58:21.688439+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:58:21.688439+0000","last_undegraded":"2024-03-23T23:58:21.688439+0000","last_fullsized":"2024-03-23T23:58:21.688439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568569+0000","last_change":"2024-03-23T23:56:29.892444+0000","last_active":"2024-03-23T23:58:16.568569+0000","last_peered":"2024-03-23T23:58:16.568569+0000","last_clean":"2024-03-23T23:58:16.568569+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:58:16.568569+0000","last_undegraded":"2024-03-23T23:58:16.568569+0000","last_fullsized":"2024-03-23T23:58:16.568569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.577429+0000","last_change":"2024-03-23T23:56:29.887065+0000","last_active":"2024-03-23T23:58:16.577429+0000","last_peered":"2024-03-23T23:58:16.577429+0000","last_clean":"2024-03-23T23:58:16.577429+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:58:16.577429+0000","last_undegraded":"2024-03-23T23:58:16.577429+0000","last_fullsized":"2024-03-23T23:58:16.577429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:05:45.290286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'17","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.676231+0000","last_change":"2024-03-23T23:56:30.881409+0000","last_active":"2024-03-23T23:58:21.676231+0000","last_peered":"2024-03-23T23:58:21.676231+0000","last_clean":"2024-03-23T23:58:21.676231+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:58:21.676231+0000","last_undegraded":"2024-03-23T23:58:21.676231+0000","last_fullsized":"2024-03-23T23:58:21.676231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593896+0000","last_change":"2024-03-23T23:56:29.897340+0000","last_active":"2024-03-23T23:58:16.593896+0000","last_peered":"2024-03-23T23:58:16.593896+0000","last_clean":"2024-03-23T23:58:16.593896+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:58:16.593896+0000","last_undegraded":"2024-03-23T23:58:16.593896+0000","last_fullsized":"2024-03-23T23:58:16.593896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'18","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.664356+0000","last_change":"2024-03-23T23:56:30.876574+0000","last_active":"2024-03-23T23:58:21.664356+0000","last_peered":"2024-03-23T23:58:21.664356+0000","last_clean":"2024-03-23T23:58:21.664356+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:58:21.664356+0000","last_undegraded":"2024-03-23T23:58:21.664356+0000","last_fullsized":"2024-03-23T23:58:21.664356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.569976+0000","last_change":"2024-03-23T23:56:29.894494+0000","last_active":"2024-03-23T23:58:16.569976+0000","last_peered":"2024-03-23T23:58:16.569976+0000","last_clean":"2024-03-23T23:58:16.569976+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:58:16.569976+0000","last_undegraded":"2024-03-23T23:58:16.569976+0000","last_fullsized":"2024-03-23T23:58:16.569976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'17","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.679738+0000","last_change":"2024-03-23T23:56:30.891335+0000","last_active":"2024-03-23T23:58:21.679738+0000","last_peered":"2024-03-23T23:58:21.679738+0000","last_clean":"2024-03-23T23:58:21.679738+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:58:21.679738+0000","last_undegraded":"2024-03-23T23:58:21.679738+0000","last_fullsized":"2024-03-23T23:58:21.679738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:20:51.265789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.595318+0000","last_change":"2024-03-23T23:56:29.886369+0000","last_active":"2024-03-23T23:58:16.595318+0000","last_peered":"2024-03-23T23:58:16.595318+0000","last_clean":"2024-03-23T23:58:16.595318+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:58:16.595318+0000","last_undegraded":"2024-03-23T23:58:16.595318+0000","last_fullsized":"2024-03-23T23:58:16.595318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'17","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.688534+0000","last_change":"2024-03-23T23:56:30.876882+0000","last_active":"2024-03-23T23:58:21.688534+0000","last_peered":"2024-03-23T23:58:21.688534+0000","last_clean":"2024-03-23T23:58:21.688534+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:58:21.688534+0000","last_undegraded":"2024-03-23T23:58:21.688534+0000","last_fullsized":"2024-03-23T23:58:21.688534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'10","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:22.085909+0000","last_change":"2024-03-23T23:56:29.886611+0000","last_active":"2024-03-23T23:58:22.085909+0000","last_peered":"2024-03-23T23:58:22.085909+0000","last_clean":"2024-03-23T23:58:22.085909+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:58:22.085909+0000","last_undegraded":"2024-03-23T23:58:22.085909+0000","last_fullsized":"2024-03-23T23:58:22.085909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'19","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.684231+0000","last_change":"2024-03-23T23:56:30.871258+0000","last_active":"2024-03-23T23:58:21.684231+0000","last_peered":"2024-03-23T23:58:21.684231+0000","last_clean":"2024-03-23T23:58:21.684231+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:58:21.684231+0000","last_undegraded":"2024-03-23T23:58:21.684231+0000","last_fullsized":"2024-03-23T23:58:21.684231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:12.879233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'119","reported_seq":139,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:22.082597+0000","last_change":"2024-03-23T23:56:29.886316+0000","last_active":"2024-03-23T23:58:22.082597+0000","last_peered":"2024-03-23T23:58:22.082597+0000","last_clean":"2024-03-23T23:58:22.082597+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:58:22.082597+0000","last_undegraded":"2024-03-23T23:58:22.082597+0000","last_fullsized":"2024-03-23T23:58:22.082597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145514,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'14","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.693117+0000","last_change":"2024-03-23T23:56:30.885592+0000","last_active":"2024-03-23T23:58:21.693117+0000","last_peered":"2024-03-23T23:58:21.693117+0000","last_clean":"2024-03-23T23:58:21.693117+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:58:21.693117+0000","last_undegraded":"2024-03-23T23:58:21.693117+0000","last_fullsized":"2024-03-23T23:58:21.693117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:26:58.077808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'5","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.873052+0000","last_change":"2024-03-23T23:58:27.873143+0000","last_active":"2024-03-23T23:58:27.873052+0000","last_peered":"2024-03-23T23:58:27.873052+0000","last_clean":"2024-03-23T23:58:27.873052+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:58:27.873052+0000","last_undegraded":"2024-03-23T23:58:27.873052+0000","last_fullsized":"2024-03-23T23:58:27.873052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-03-23T23:58:27.872879+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-03-23T23:58:27.872879+0000","last_clean_scrub_stamp":"2024-03-23T23:58:27.872879+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:50:37.441177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'19","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.685707+0000","last_change":"2024-03-23T23:56:30.886240+0000","last_active":"2024-03-23T23:58:21.685707+0000","last_peered":"2024-03-23T23:58:21.685707+0000","last_clean":"2024-03-23T23:58:21.685707+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:58:21.685707+0000","last_undegraded":"2024-03-23T23:58:21.685707+0000","last_fullsized":"2024-03-23T23:58:21.685707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594083+0000","last_change":"2024-03-23T23:56:29.890485+0000","last_active":"2024-03-23T23:58:16.594083+0000","last_peered":"2024-03-23T23:58:16.594083+0000","last_clean":"2024-03-23T23:58:16.594083+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:58:16.594083+0000","last_undegraded":"2024-03-23T23:58:16.594083+0000","last_fullsized":"2024-03-23T23:58:16.594083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'27","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.690066+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:58:21.690066+0000","last_peered":"2024-03-23T23:58:21.690066+0000","last_clean":"2024-03-23T23:58:21.690066+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:58:21.690066+0000","last_undegraded":"2024-03-23T23:58:21.690066+0000","last_fullsized":"2024-03-23T23:58:21.690066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.568289+0000","last_change":"2024-03-23T23:56:29.896833+0000","last_active":"2024-03-23T23:58:16.568289+0000","last_peered":"2024-03-23T23:58:16.568289+0000","last_clean":"2024-03-23T23:58:16.568289+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:58:16.568289+0000","last_undegraded":"2024-03-23T23:58:16.568289+0000","last_fullsized":"2024-03-23T23:58:16.568289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'15","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.674585+0000","last_change":"2024-03-23T23:56:30.876178+0000","last_active":"2024-03-23T23:58:21.674585+0000","last_peered":"2024-03-23T23:58:21.674585+0000","last_clean":"2024-03-23T23:58:21.674585+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:58:21.674585+0000","last_undegraded":"2024-03-23T23:58:21.674585+0000","last_fullsized":"2024-03-23T23:58:21.674585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.565880+0000","last_change":"2024-03-23T23:56:29.879437+0000","last_active":"2024-03-23T23:58:16.565880+0000","last_peered":"2024-03-23T23:58:16.565880+0000","last_clean":"2024-03-23T23:58:16.565880+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:58:16.565880+0000","last_undegraded":"2024-03-23T23:58:16.565880+0000","last_fullsized":"2024-03-23T23:58:16.565880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'14","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.691138+0000","last_change":"2024-03-23T23:56:30.888310+0000","last_active":"2024-03-23T23:58:21.691138+0000","last_peered":"2024-03-23T23:58:21.691138+0000","last_clean":"2024-03-23T23:58:21.691138+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:58:21.691138+0000","last_undegraded":"2024-03-23T23:58:21.691138+0000","last_fullsized":"2024-03-23T23:58:21.691138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:10:41.634569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.572015+0000","last_change":"2024-03-23T23:56:29.892548+0000","last_active":"2024-03-23T23:58:16.572015+0000","last_peered":"2024-03-23T23:58:16.572015+0000","last_clean":"2024-03-23T23:58:16.572015+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:58:16.572015+0000","last_undegraded":"2024-03-23T23:58:16.572015+0000","last_fullsized":"2024-03-23T23:58:16.572015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:53:30.285127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'12","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.690215+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:58:21.690215+0000","last_peered":"2024-03-23T23:58:21.690215+0000","last_clean":"2024-03-23T23:58:21.690215+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:58:21.690215+0000","last_undegraded":"2024-03-23T23:58:21.690215+0000","last_fullsized":"2024-03-23T23:58:21.690215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.567155+0000","last_change":"2024-03-23T23:56:29.883486+0000","last_active":"2024-03-23T23:58:16.567155+0000","last_peered":"2024-03-23T23:58:16.567155+0000","last_clean":"2024-03-23T23:58:16.567155+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:58:16.567155+0000","last_undegraded":"2024-03-23T23:58:16.567155+0000","last_fullsized":"2024-03-23T23:58:16.567155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'17","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.691284+0000","last_change":"2024-03-23T23:56:30.887560+0000","last_active":"2024-03-23T23:58:21.691284+0000","last_peered":"2024-03-23T23:58:21.691284+0000","last_clean":"2024-03-23T23:58:21.691284+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:58:21.691284+0000","last_undegraded":"2024-03-23T23:58:21.691284+0000","last_fullsized":"2024-03-23T23:58:21.691284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596235+0000","last_change":"2024-03-23T23:56:29.897890+0000","last_active":"2024-03-23T23:58:16.596235+0000","last_peered":"2024-03-23T23:58:16.596235+0000","last_clean":"2024-03-23T23:58:16.596235+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:58:16.596235+0000","last_undegraded":"2024-03-23T23:58:16.596235+0000","last_fullsized":"2024-03-23T23:58:16.596235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.686492+0000","last_change":"2024-03-23T23:56:30.888006+0000","last_active":"2024-03-23T23:58:21.686492+0000","last_peered":"2024-03-23T23:58:21.686492+0000","last_clean":"2024-03-23T23:58:21.686492+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:58:21.686492+0000","last_undegraded":"2024-03-23T23:58:21.686492+0000","last_fullsized":"2024-03-23T23:58:21.686492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:13:29.774403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.566636+0000","last_change":"2024-03-23T23:56:29.888464+0000","last_active":"2024-03-23T23:58:16.566636+0000","last_peered":"2024-03-23T23:58:16.566636+0000","last_clean":"2024-03-23T23:58:16.566636+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:58:16.566636+0000","last_undegraded":"2024-03-23T23:58:16.566636+0000","last_fullsized":"2024-03-23T23:58:16.566636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'15","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.689964+0000","last_change":"2024-03-23T23:56:30.883536+0000","last_active":"2024-03-23T23:58:21.689964+0000","last_peered":"2024-03-23T23:58:21.689964+0000","last_clean":"2024-03-23T23:58:21.689964+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:58:21.689964+0000","last_undegraded":"2024-03-23T23:58:21.689964+0000","last_fullsized":"2024-03-23T23:58:21.689964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:30:07.738547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594918+0000","last_change":"2024-03-23T23:56:21.617670+0000","last_active":"2024-03-23T23:58:16.594918+0000","last_peered":"2024-03-23T23:58:16.594918+0000","last_clean":"2024-03-23T23:58:16.594918+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:58:16.594918+0000","last_undegraded":"2024-03-23T23:58:16.594918+0000","last_fullsized":"2024-03-23T23:58:16.594918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:19.671431+0000","last_clean_scrub_stamp":"2024-03-23T23:56:19.671431+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:36:42.990780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.593648+0000","last_change":"2024-03-23T23:56:29.886033+0000","last_active":"2024-03-23T23:58:16.593648+0000","last_peered":"2024-03-23T23:58:16.593648+0000","last_clean":"2024-03-23T23:58:16.593648+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:58:16.593648+0000","last_undegraded":"2024-03-23T23:58:16.593648+0000","last_fullsized":"2024-03-23T23:58:16.593648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:03:14.816994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'10","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.681547+0000","last_change":"2024-03-23T23:56:30.883752+0000","last_active":"2024-03-23T23:58:21.681547+0000","last_peered":"2024-03-23T23:58:21.681547+0000","last_clean":"2024-03-23T23:58:21.681547+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:58:21.681547+0000","last_undegraded":"2024-03-23T23:58:21.681547+0000","last_fullsized":"2024-03-23T23:58:21.681547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:51:44.364444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594644+0000","last_change":"2024-03-23T23:56:29.881565+0000","last_active":"2024-03-23T23:58:16.594644+0000","last_peered":"2024-03-23T23:58:16.594644+0000","last_clean":"2024-03-23T23:58:16.594644+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:58:16.594644+0000","last_undegraded":"2024-03-23T23:58:16.594644+0000","last_fullsized":"2024-03-23T23:58:16.594644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:37:37.413862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'10","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.689163+0000","last_change":"2024-03-23T23:56:30.886503+0000","last_active":"2024-03-23T23:58:21.689163+0000","last_peered":"2024-03-23T23:58:21.689163+0000","last_clean":"2024-03-23T23:58:21.689163+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:58:21.689163+0000","last_undegraded":"2024-03-23T23:58:21.689163+0000","last_fullsized":"2024-03-23T23:58:21.689163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'10","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:22.078484+0000","last_change":"2024-03-23T23:56:29.886668+0000","last_active":"2024-03-23T23:58:22.078484+0000","last_peered":"2024-03-23T23:58:22.078484+0000","last_clean":"2024-03-23T23:58:22.078484+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:58:22.078484+0000","last_undegraded":"2024-03-23T23:58:22.078484+0000","last_fullsized":"2024-03-23T23:58:22.078484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'21","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.667454+0000","last_change":"2024-03-23T23:56:30.873826+0000","last_active":"2024-03-23T23:58:21.667454+0000","last_peered":"2024-03-23T23:58:21.667454+0000","last_clean":"2024-03-23T23:58:21.667454+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:58:21.667454+0000","last_undegraded":"2024-03-23T23:58:21.667454+0000","last_fullsized":"2024-03-23T23:58:21.667454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594417+0000","last_change":"2024-03-23T23:56:29.889635+0000","last_active":"2024-03-23T23:58:16.594417+0000","last_peered":"2024-03-23T23:58:16.594417+0000","last_clean":"2024-03-23T23:58:16.594417+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:58:16.594417+0000","last_undegraded":"2024-03-23T23:58:16.594417+0000","last_fullsized":"2024-03-23T23:58:16.594417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'11","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.683204+0000","last_change":"2024-03-23T23:56:30.883369+0000","last_active":"2024-03-23T23:58:21.683204+0000","last_peered":"2024-03-23T23:58:21.683204+0000","last_clean":"2024-03-23T23:58:21.683204+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:58:21.683204+0000","last_undegraded":"2024-03-23T23:58:21.683204+0000","last_fullsized":"2024-03-23T23:58:21.683204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:12.049887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.894035+0000","last_change":"2024-03-23T23:58:27.894134+0000","last_active":"2024-03-23T23:58:27.894035+0000","last_peered":"2024-03-23T23:58:27.894035+0000","last_clean":"2024-03-23T23:58:27.894035+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:58:27.894035+0000","last_undegraded":"2024-03-23T23:58:27.894035+0000","last_fullsized":"2024-03-23T23:58:27.894035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:27.893788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:27.893788+0000","last_clean_scrub_stamp":"2024-03-23T23:58:27.893788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:21.401896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'13","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.687539+0000","last_change":"2024-03-23T23:56:30.888942+0000","last_active":"2024-03-23T23:58:21.687539+0000","last_peered":"2024-03-23T23:58:21.687539+0000","last_clean":"2024-03-23T23:58:21.687539+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:58:21.687539+0000","last_undegraded":"2024-03-23T23:58:21.687539+0000","last_fullsized":"2024-03-23T23:58:21.687539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:10:31.242003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.597034+0000","last_change":"2024-03-23T23:56:29.886058+0000","last_active":"2024-03-23T23:58:16.597034+0000","last_peered":"2024-03-23T23:58:16.597034+0000","last_clean":"2024-03-23T23:58:16.597034+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:58:16.597034+0000","last_undegraded":"2024-03-23T23:58:16.597034+0000","last_fullsized":"2024-03-23T23:58:16.597034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:01:16.272463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'16","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.660546+0000","last_change":"2024-03-23T23:56:30.878188+0000","last_active":"2024-03-23T23:58:21.660546+0000","last_peered":"2024-03-23T23:58:21.660546+0000","last_clean":"2024-03-23T23:58:21.660546+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:58:21.660546+0000","last_undegraded":"2024-03-23T23:58:21.660546+0000","last_fullsized":"2024-03-23T23:58:21.660546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'6","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:24.902078+0000","last_change":"2024-03-23T23:56:29.884993+0000","last_active":"2024-03-23T23:58:24.902078+0000","last_peered":"2024-03-23T23:58:24.902078+0000","last_clean":"2024-03-23T23:58:24.902078+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:58:24.902078+0000","last_undegraded":"2024-03-23T23:58:24.902078+0000","last_fullsized":"2024-03-23T23:58:24.902078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'15","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.680419+0000","last_change":"2024-03-23T23:57:11.228752+0000","last_active":"2024-03-23T23:58:21.680419+0000","last_peered":"2024-03-23T23:58:21.680419+0000","last_clean":"2024-03-23T23:58:21.680419+0000","last_became_active":"2024-03-23T23:57:11.227669+0000","last_became_peered":"2024-03-23T23:57:11.227669+0000","last_unstale":"2024-03-23T23:58:21.680419+0000","last_undegraded":"2024-03-23T23:58:21.680419+0000","last_fullsized":"2024-03-23T23:58:21.680419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.570023+0000","last_change":"2024-03-23T23:56:29.881331+0000","last_active":"2024-03-23T23:58:16.570023+0000","last_peered":"2024-03-23T23:58:16.570023+0000","last_clean":"2024-03-23T23:58:16.570023+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:58:16.570023+0000","last_undegraded":"2024-03-23T23:58:16.570023+0000","last_fullsized":"2024-03-23T23:58:16.570023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'19","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.678675+0000","last_change":"2024-03-23T23:56:30.874453+0000","last_active":"2024-03-23T23:58:21.678675+0000","last_peered":"2024-03-23T23:58:21.678675+0000","last_clean":"2024-03-23T23:58:21.678675+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:58:21.678675+0000","last_undegraded":"2024-03-23T23:58:21.678675+0000","last_fullsized":"2024-03-23T23:58:21.678675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594425+0000","last_change":"2024-03-23T23:56:29.879862+0000","last_active":"2024-03-23T23:58:16.594425+0000","last_peered":"2024-03-23T23:58:16.594425+0000","last_clean":"2024-03-23T23:58:16.594425+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:58:16.594425+0000","last_undegraded":"2024-03-23T23:58:16.594425+0000","last_fullsized":"2024-03-23T23:58:16.594425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:50:11.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'7","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.670307+0000","last_change":"2024-03-23T23:56:30.874693+0000","last_active":"2024-03-23T23:58:21.670307+0000","last_peered":"2024-03-23T23:58:21.670307+0000","last_clean":"2024-03-23T23:58:21.670307+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:58:21.670307+0000","last_undegraded":"2024-03-23T23:58:21.670307+0000","last_fullsized":"2024-03-23T23:58:21.670307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:59.556666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594683+0000","last_change":"2024-03-23T23:56:29.887900+0000","last_active":"2024-03-23T23:58:16.594683+0000","last_peered":"2024-03-23T23:58:16.594683+0000","last_clean":"2024-03-23T23:58:16.594683+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:58:16.594683+0000","last_undegraded":"2024-03-23T23:58:16.594683+0000","last_fullsized":"2024-03-23T23:58:16.594683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'16","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.666668+0000","last_change":"2024-03-23T23:56:30.875932+0000","last_active":"2024-03-23T23:58:21.666668+0000","last_peered":"2024-03-23T23:58:21.666668+0000","last_clean":"2024-03-23T23:58:21.666668+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:58:21.666668+0000","last_undegraded":"2024-03-23T23:58:21.666668+0000","last_fullsized":"2024-03-23T23:58:21.666668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:36:50.089728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.594589+0000","last_change":"2024-03-23T23:56:29.884727+0000","last_active":"2024-03-23T23:58:16.594589+0000","last_peered":"2024-03-23T23:58:16.594589+0000","last_clean":"2024-03-23T23:58:16.594589+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:58:16.594589+0000","last_undegraded":"2024-03-23T23:58:16.594589+0000","last_fullsized":"2024-03-23T23:58:16.594589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'18","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.677615+0000","last_change":"2024-03-23T23:56:30.887213+0000","last_active":"2024-03-23T23:58:21.677615+0000","last_peered":"2024-03-23T23:58:21.677615+0000","last_clean":"2024-03-23T23:58:21.677615+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:58:21.677615+0000","last_undegraded":"2024-03-23T23:58:21.677615+0000","last_fullsized":"2024-03-23T23:58:21.677615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:48:41.084757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596027+0000","last_change":"2024-03-23T23:56:29.895498+0000","last_active":"2024-03-23T23:58:16.596027+0000","last_peered":"2024-03-23T23:58:16.596027+0000","last_clean":"2024-03-23T23:58:16.596027+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:58:16.596027+0000","last_undegraded":"2024-03-23T23:58:16.596027+0000","last_fullsized":"2024-03-23T23:58:16.596027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:59.162061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'14","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.677375+0000","last_change":"2024-03-23T23:56:30.884001+0000","last_active":"2024-03-23T23:58:21.677375+0000","last_peered":"2024-03-23T23:58:21.677375+0000","last_clean":"2024-03-23T23:58:21.677375+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:58:21.677375+0000","last_undegraded":"2024-03-23T23:58:21.677375+0000","last_fullsized":"2024-03-23T23:58:21.677375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:33.602827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'23","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.686411+0000","last_change":"2024-03-23T23:56:30.889155+0000","last_active":"2024-03-23T23:58:21.686411+0000","last_peered":"2024-03-23T23:58:21.686411+0000","last_clean":"2024-03-23T23:58:21.686411+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:58:21.686411+0000","last_undegraded":"2024-03-23T23:58:21.686411+0000","last_fullsized":"2024-03-23T23:58:21.686411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T04:24:45.204670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596405+0000","last_change":"2024-03-23T23:56:29.888617+0000","last_active":"2024-03-23T23:58:16.596405+0000","last_peered":"2024-03-23T23:58:16.596405+0000","last_clean":"2024-03-23T23:58:16.596405+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:58:16.596405+0000","last_undegraded":"2024-03-23T23:58:16.596405+0000","last_fullsized":"2024-03-23T23:58:16.596405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:43:11.863155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'13","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.688014+0000","last_change":"2024-03-23T23:56:30.888308+0000","last_active":"2024-03-23T23:58:21.688014+0000","last_peered":"2024-03-23T23:58:21.688014+0000","last_clean":"2024-03-23T23:58:21.688014+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:58:21.688014+0000","last_undegraded":"2024-03-23T23:58:21.688014+0000","last_fullsized":"2024-03-23T23:58:21.688014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:05:02.611531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"23'3","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.596826+0000","last_change":"2024-03-23T23:56:29.879942+0000","last_active":"2024-03-23T23:58:16.596826+0000","last_peered":"2024-03-23T23:58:16.596826+0000","last_clean":"2024-03-23T23:58:16.596826+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:58:16.596826+0000","last_undegraded":"2024-03-23T23:58:16.596826+0000","last_fullsized":"2024-03-23T23:58:16.596826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:58.540588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'16","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.678572+0000","last_change":"2024-03-23T23:57:11.438439+0000","last_active":"2024-03-23T23:58:21.678572+0000","last_peered":"2024-03-23T23:58:21.678572+0000","last_clean":"2024-03-23T23:58:21.678572+0000","last_became_active":"2024-03-23T23:57:11.437365+0000","last_became_peered":"2024-03-23T23:57:11.437365+0000","last_unstale":"2024-03-23T23:58:21.678572+0000","last_undegraded":"2024-03-23T23:58:21.678572+0000","last_fullsized":"2024-03-23T23:58:21.678572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:16.578142+0000","last_change":"2024-03-23T23:56:29.889380+0000","last_active":"2024-03-23T23:58:16.578142+0000","last_peered":"2024-03-23T23:58:16.578142+0000","last_clean":"2024-03-23T23:58:16.578142+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:58:16.578142+0000","last_undegraded":"2024-03-23T23:58:16.578142+0000","last_fullsized":"2024-03-23T23:58:16.578142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:28.817528+0000","last_clean_scrub_stamp":"2024-03-23T23:56:28.817528+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:56:48.860133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'11","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.675594+0000","last_change":"2024-03-23T23:57:11.078716+0000","last_active":"2024-03-23T23:58:21.675594+0000","last_peered":"2024-03-23T23:58:21.675594+0000","last_clean":"2024-03-23T23:58:21.675594+0000","last_became_active":"2024-03-23T23:57:11.077960+0000","last_became_peered":"2024-03-23T23:57:11.077960+0000","last_unstale":"2024-03-23T23:58:21.675594+0000","last_undegraded":"2024-03-23T23:58:21.675594+0000","last_fullsized":"2024-03-23T23:58:21.675594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"24'6","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:26.902521+0000","last_change":"2024-03-23T23:58:26.902590+0000","last_active":"2024-03-23T23:58:26.902521+0000","last_peered":"2024-03-23T23:58:26.902521+0000","last_clean":"2024-03-23T23:58:26.902521+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:58:26.902521+0000","last_undegraded":"2024-03-23T23:58:26.902521+0000","last_fullsized":"2024-03-23T23:58:26.902521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-03-23T23:58:26.902292+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-03-23T23:58:26.902292+0000","last_clean_scrub_stamp":"2024-03-23T23:58:26.902292+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:20.410400+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":42,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":147423,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":180,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":294846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":864256,"data_stored":684857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":239412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":93994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":94027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":240532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":95015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":94061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":684910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":146625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":145514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:32.431 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.431 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.431 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.431 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.431 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.432 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.432 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.432 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.432 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.432 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.432 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.433 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.433 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.433 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.433 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.433 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.433 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.434 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.434 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.434 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.434 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.434 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.434 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.434 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.435 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.435 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.435 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.435 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.435 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.435 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.435 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.436 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.436 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.436 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.436 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.436 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.436 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.437 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.437 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.437 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.437 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.437 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.437 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.438 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.438 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.438 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.438 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.438 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.438 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.439 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.439 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.439 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.439 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.439 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.439 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.439 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.440 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.440 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.440 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.440 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.440 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.440 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.440 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.441 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-23T23:56:19.671431+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=19, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.441 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.441 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.441 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.441 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.441 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.442 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.442 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.442 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.442 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.442 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.442 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.443 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.443 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.443 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.443 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.443 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.443 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.444 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.444 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.444 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.444 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.444 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.444 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.445 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.445 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.445 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.445 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.445 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.445 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-23T23:56:28.817528+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=28, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.446 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:32.446 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T23:58:45.533 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:45.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:58:52.446 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:58:52.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.676+0000 7f991e400640 1 Processor -- start 2024-03-23T23:58:52.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.676+0000 7f991e400640 1 -- start start 2024-03-23T23:58:52.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.677+0000 7f991e400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99180b6d30 0x7f99180b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.677+0000 7f991e400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180b4590 con 0x7f9918140e00 2024-03-23T23:58:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.677+0000 7f991e400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99180b56c0 con 0x7f99180b41b0 2024-03-23T23:58:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.678+0000 7f991e400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99180b9930 con 0x7f99180b6d30 2024-03-23T23:58:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.678+0000 7f991da00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9918140e00 0x7f9918141290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:37330/0 (socket says 172.21.15.31:37330) 2024-03-23T23:58:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.678+0000 7f991da00640 1 -- 172.21.15.31:0/733198371 learned_addr learned my addr 172.21.15.31:0/733198371 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:58:52.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.678+0000 7f9917e00640 1 --2- 172.21.15.31:0/733198371 >> v2:172.21.15.59:3300/0 conn(0x7f99180b6d30 0x7f99180b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.678+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869260165 0 0) 0x7f99180b4590 con 0x7f9918140e00 2024-03-23T23:58:52.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.678+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9900003520 con 0x7f9918140e00 2024-03-23T23:58:52.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176664231 0 0) 0x7f9900003520 con 0x7f9918140e00 2024-03-23T23:58:52.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 >> v2:172.21.15.59:3300/0 conn(0x7f99180b6d30 msgr2=0x7f99180b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 --2- 172.21.15.31:0/733198371 >> v2:172.21.15.59:3300/0 conn(0x7f99180b6d30 0x7f99180b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 >> v1:172.21.15.59:6789/0 conn(0x7f99180b41b0 legacy=0x7f99181471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99180b9c10 con 0x7f9918140e00 2024-03-23T23:58:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f99100019f0 con 0x7f9918140e00 2024-03-23T23:58:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 >> v1:172.21.15.31:6789/0 conn(0x7f9918140e00 legacy=0x7f9918141290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9900003a20 0x7f9900003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9900004800 0x7f9900004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99000051c0 0x7f990000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b9930 con 0x7f99000051c0 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990000c0f0 con 0x7f9900003a20 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990000c2f0 con 0x7f9900004800 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f991da00640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99000051c0 0x7f990000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.679+0000 7f991d000640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9900003a20 0x7f9900003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.680+0000 7f9917e00640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9900004800 0x7f9900004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.680+0000 7f991da00640 1 -- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9900004800 msgr2=0x7f9900004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.680+0000 7f991da00640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9900004800 0x7f9900004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.680+0000 7f991da00640 1 -- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9900003a20 msgr2=0x7f9900003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.680+0000 7f991da00640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9900003a20 0x7f9900003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.680+0000 7f991da00640 1 -- 172.21.15.31:0/733198371 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900003520 con 0x7f99000051c0 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.681+0000 7f991da00640 1 -- 172.21.15.31:0/733198371 reap_dead start 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.681+0000 7f991da00640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99000051c0 0x7f990000b9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f991000a840 tx=0x7f9900005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cebd6b76b11eac server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.681+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000a460 con 0x7f99000051c0 2024-03-23T23:58:52.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.681+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910034650 con 0x7f99000051c0 2024-03-23T23:58:52.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.681+0000 7f9917400640 1 -- 172.21.15.31:0/733198371 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910034a40 con 0x7f99000051c0 2024-03-23T23:58:52.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.682+0000 7f991e400640 1 -- 172.21.15.31:0/733198371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99000051c0 msgr2=0x7f990000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:52.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.682+0000 7f991e400640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99000051c0 0x7f990000b9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f991000a840 tx=0x7f9900005830 comp rx=0 tx=0).stop 2024-03-23T23:58:52.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.682+0000 7f991e400640 1 -- 172.21.15.31:0/733198371 shutdown_connections 2024-03-23T23:58:52.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.682+0000 7f991e400640 1 --2- 172.21.15.31:0/733198371 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99000051c0 0x7f990000b9c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.682+0000 7f991e400640 1 -- 172.21.15.31:0/733198371 >> 172.21.15.31:0/733198371 conn(0x7f9918066fb0 msgr2=0x7f99180673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:52.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.682+0000 7f991e400640 1 -- 172.21.15.31:0/733198371 shutdown_connections 2024-03-23T23:58:52.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.682+0000 7f991e400640 1 -- 172.21.15.31:0/733198371 wait complete. 2024-03-23T23:58:52.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.684+0000 7f991e400640 1 Processor -- start 2024-03-23T23:58:52.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.684+0000 7f991e400640 1 -- start start 2024-03-23T23:58:52.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.684+0000 7f991e400640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99000051c0 0x7f99180bcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9918143510 0x7f9918143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991813b360 0x7f991813b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991e400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b5220 con 0x7f991813b360 2024-03-23T23:58:52.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b50a0 con 0x7f9918143510 2024-03-23T23:58:52.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991e400640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99180b53a0 con 0x7f99000051c0 2024-03-23T23:58:52.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991813b360 0x7f991813b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991813b360 0x7f991813b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38516/0 (socket says 172.21.15.31:38516) 2024-03-23T23:58:52.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 -- 172.21.15.31:0/1233303936 learned_addr learned my addr 172.21.15.31:0/1233303936 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:58:52.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f9917e00640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9918143510 0x7f9918143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991d000640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99000051c0 0x7f99180bcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 -- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99000051c0 msgr2=0x7f99180bcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:52.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99000051c0 0x7f99180bcae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 -- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9918143510 msgr2=0x7f9918143990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:52.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9918143510 0x7f9918143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.685+0000 7f991da00640 1 -- 172.21.15.31:0/1233303936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918143ed0 con 0x7f991813b360 2024-03-23T23:58:52.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.686+0000 7f991da00640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991813b360 0x7f991813b7e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f991002cc50 tx=0x7f99180b9de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:52.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.686+0000 7f9914c00640 1 -- 172.21.15.31:0/1233303936 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910043070 con 0x7f991813b360 2024-03-23T23:58:52.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.686+0000 7f9914c00640 1 -- 172.21.15.31:0/1233303936 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910001250 con 0x7f991813b360 2024-03-23T23:58:52.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.686+0000 7f9914c00640 1 -- 172.21.15.31:0/1233303936 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910039040 con 0x7f991813b360 2024-03-23T23:58:52.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.686+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99181d18b0 con 0x7f991813b360 2024-03-23T23:58:52.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.686+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9918144980 con 0x7f991813b360 2024-03-23T23:58:52.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.687+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9918147cc0 con 0x7f991813b360 2024-03-23T23:58:52.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.688+0000 7f9914c00640 1 -- 172.21.15.31:0/1233303936 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9910046070 con 0x7f991813b360 2024-03-23T23:58:52.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.689+0000 7f9914c00640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f98f806bc50 0x7f98f806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:58:52.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.689+0000 7f9914c00640 1 -- 172.21.15.31:0/1233303936 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f99100abd40 con 0x7f991813b360 2024-03-23T23:58:52.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.690+0000 7f991d000640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f98f806bc50 0x7f98f806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:58:52.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.691+0000 7f991d000640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f98f806bc50 0x7f98f806e110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f990c007fd0 tx=0x7f990c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:58:52.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.694+0000 7f9914c00640 1 -- 172.21.15.31:0/1233303936 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9918147cc0 con 0x7f991813b360 2024-03-23T23:58:52.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.893+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99180752c0 con 0x7f98f806bc50 2024-03-23T23:58:52.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.912+0000 7f9914c00640 1 -- 172.21.15.31:0/1233303936 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252497 (secure 0 0 0) 0x7f99180752c0 con 0x7f98f806bc50 2024-03-23T23:58:52.916 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:58:52.918 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:58:52.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f98f806bc50 msgr2=0x7f98f806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:52.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f98f806bc50 0x7f98f806e110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f990c007fd0 tx=0x7f990c009040 comp rx=0 tx=0).stop 2024-03-23T23:58:52.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991813b360 msgr2=0x7f991813b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:58:52.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991813b360 0x7f991813b7e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f991002cc50 tx=0x7f99180b9de0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 shutdown_connections 2024-03-23T23:58:52.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f98f806bc50 0x7f98f806e110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9918143510 0x7f9918143990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f991813b360 0x7f991813b7e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 --2- 172.21.15.31:0/1233303936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99000051c0 0x7f99180bcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:58:52.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 >> 172.21.15.31:0/1233303936 conn(0x7f9918066fb0 msgr2=0x7f9918146ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:58:52.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 shutdown_connections 2024-03-23T23:58:52.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:58:52.918+0000 7f991e400640 1 -- 172.21.15.31:0/1233303936 wait complete. 2024-03-23T23:58:52.938 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-03-23T23:58:51.381463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":738950,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":125,"num_read_kb":109,"num_write":358,"num_write_kb":2666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1346,"ondisk_log_size":1346,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223840,"kb_used_data":3552,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750880,"statfs":{"total":773094113280,"available":772864901120,"internally_reserved":0,"allocated":3637248,"data_stored":2229084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005114"},"pg_stats":[{"pgid":"3.3f","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.763478+0000","last_change":"2024-03-23T23:58:45.763553+0000","last_active":"2024-03-23T23:58:45.763478+0000","last_peered":"2024-03-23T23:58:45.763478+0000","last_clean":"2024-03-23T23:58:45.763478+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:58:45.763478+0000","last_undegraded":"2024-03-23T23:58:45.763478+0000","last_fullsized":"2024-03-23T23:58:45.763478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:45.763262+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:45.763262+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.763262+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:13.336721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.985305+0000","last_change":"2024-03-23T23:58:35.985305+0000","last_active":"2024-03-23T23:58:35.985305+0000","last_peered":"2024-03-23T23:58:35.985305+0000","last_clean":"2024-03-23T23:58:35.985305+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:58:35.985305+0000","last_undegraded":"2024-03-23T23:58:35.985305+0000","last_fullsized":"2024-03-23T23:58:35.985305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:35.984886+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:35.984886+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.984886+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:06:04.839561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.927749+0000","last_change":"2024-03-23T23:58:32.927749+0000","last_active":"2024-03-23T23:58:32.927749+0000","last_peered":"2024-03-23T23:58:32.927749+0000","last_clean":"2024-03-23T23:58:32.927749+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:58:32.927749+0000","last_undegraded":"2024-03-23T23:58:32.927749+0000","last_fullsized":"2024-03-23T23:58:32.927749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:32.927500+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:32.927500+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.927500+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:31:35.377079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'12","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.301234+0000","last_change":"2024-03-23T23:58:43.301297+0000","last_active":"2024-03-23T23:58:43.301234+0000","last_peered":"2024-03-23T23:58:43.301234+0000","last_clean":"2024-03-23T23:58:43.301234+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:58:43.301234+0000","last_undegraded":"2024-03-23T23:58:43.301234+0000","last_fullsized":"2024-03-23T23:58:43.301234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-03-23T23:58:43.301025+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-03-23T23:58:43.301025+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.301025+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:18.105052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'15","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.825983+0000","last_change":"2024-03-23T23:58:41.826047+0000","last_active":"2024-03-23T23:58:41.825983+0000","last_peered":"2024-03-23T23:58:41.825983+0000","last_clean":"2024-03-23T23:58:41.825983+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:58:41.825983+0000","last_undegraded":"2024-03-23T23:58:41.825983+0000","last_fullsized":"2024-03-23T23:58:41.825983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:41.825783+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:41.825783+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.825783+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:06:24.371479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'10","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.300682+0000","last_change":"2024-03-23T23:58:45.300817+0000","last_active":"2024-03-23T23:58:45.300682+0000","last_peered":"2024-03-23T23:58:45.300682+0000","last_clean":"2024-03-23T23:58:45.300682+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:58:45.300682+0000","last_undegraded":"2024-03-23T23:58:45.300682+0000","last_fullsized":"2024-03-23T23:58:45.300682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:45.300286+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:45.300286+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.300286+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:41:10.708365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'11","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.816543+0000","last_change":"2024-03-23T23:58:43.816769+0000","last_active":"2024-03-23T23:58:43.816543+0000","last_peered":"2024-03-23T23:58:43.816543+0000","last_clean":"2024-03-23T23:58:43.816543+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:58:43.816543+0000","last_undegraded":"2024-03-23T23:58:43.816543+0000","last_fullsized":"2024-03-23T23:58:43.816543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:43.816306+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:43.816306+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.816306+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:18.625125+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'10","reported_seq":37,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.642566+0000","last_change":"2024-03-23T23:58:33.642625+0000","last_active":"2024-03-23T23:58:33.642566+0000","last_peered":"2024-03-23T23:58:33.642566+0000","last_clean":"2024-03-23T23:58:33.642566+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:58:33.642566+0000","last_undegraded":"2024-03-23T23:58:33.642566+0000","last_fullsized":"2024-03-23T23:58:33.642566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:33.642364+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:33.642364+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.642364+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:31:36.091943+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'18","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.837594+0000","last_change":"2024-03-23T23:58:42.837795+0000","last_active":"2024-03-23T23:58:42.837594+0000","last_peered":"2024-03-23T23:58:42.837594+0000","last_clean":"2024-03-23T23:58:42.837594+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:58:42.837594+0000","last_undegraded":"2024-03-23T23:58:42.837594+0000","last_fullsized":"2024-03-23T23:58:42.837594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:42.837349+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:42.837349+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.837349+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:25:54.743621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'26","reported_seq":53,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.408389+0000","last_change":"2024-03-23T23:58:42.408450+0000","last_active":"2024-03-23T23:58:42.408389+0000","last_peered":"2024-03-23T23:58:42.408389+0000","last_clean":"2024-03-23T23:58:42.408389+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:58:42.408389+0000","last_undegraded":"2024-03-23T23:58:42.408389+0000","last_fullsized":"2024-03-23T23:58:42.408389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'26","last_scrub_stamp":"2024-03-23T23:58:42.408193+0000","last_deep_scrub":"24'26","last_deep_scrub_stamp":"2024-03-23T23:58:42.408193+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.408193+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:45:52.164516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'14","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.450763+0000","last_change":"2024-03-23T23:58:39.450942+0000","last_active":"2024-03-23T23:58:39.450763+0000","last_peered":"2024-03-23T23:58:39.450763+0000","last_clean":"2024-03-23T23:58:39.450763+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:58:39.450763+0000","last_undegraded":"2024-03-23T23:58:39.450763+0000","last_fullsized":"2024-03-23T23:58:39.450763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:39.450511+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:39.450511+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.450511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:53:57.741224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'12","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.977600+0000","last_change":"2024-03-23T23:58:30.977664+0000","last_active":"2024-03-23T23:58:30.977600+0000","last_peered":"2024-03-23T23:58:30.977600+0000","last_clean":"2024-03-23T23:58:30.977600+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:58:30.977600+0000","last_undegraded":"2024-03-23T23:58:30.977600+0000","last_fullsized":"2024-03-23T23:58:30.977600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-03-23T23:58:30.977385+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-03-23T23:58:30.977385+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.977385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:20:06.310483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'18","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.600539+0000","last_change":"2024-03-23T23:58:34.600672+0000","last_active":"2024-03-23T23:58:34.600539+0000","last_peered":"2024-03-23T23:58:34.600539+0000","last_clean":"2024-03-23T23:58:34.600539+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:58:34.600539+0000","last_undegraded":"2024-03-23T23:58:34.600539+0000","last_fullsized":"2024-03-23T23:58:34.600539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:34.600293+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:34.600293+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.600293+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:28:34.266679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'20","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.918783+0000","last_change":"2024-03-23T23:58:29.918807+0000","last_active":"2024-03-23T23:58:29.918783+0000","last_peered":"2024-03-23T23:58:29.918783+0000","last_clean":"2024-03-23T23:58:29.918783+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:58:29.918783+0000","last_undegraded":"2024-03-23T23:58:29.918783+0000","last_fullsized":"2024-03-23T23:58:29.918783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'20","last_scrub_stamp":"2024-03-23T23:58:29.918713+0000","last_deep_scrub":"24'20","last_deep_scrub_stamp":"2024-03-23T23:58:29.918713+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.918713+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:40.266849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'17","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.981830+0000","last_change":"2024-03-23T23:58:33.982034+0000","last_active":"2024-03-23T23:58:33.981830+0000","last_peered":"2024-03-23T23:58:33.981830+0000","last_clean":"2024-03-23T23:58:33.981830+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:58:33.981830+0000","last_undegraded":"2024-03-23T23:58:33.981830+0000","last_fullsized":"2024-03-23T23:58:33.981830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:33.981604+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:33.981604+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.981604+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:15.087325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'21","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.253530+0000","last_change":"2024-03-23T23:58:36.253644+0000","last_active":"2024-03-23T23:58:36.253530+0000","last_peered":"2024-03-23T23:58:36.253530+0000","last_clean":"2024-03-23T23:58:36.253530+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:58:36.253530+0000","last_undegraded":"2024-03-23T23:58:36.253530+0000","last_fullsized":"2024-03-23T23:58:36.253530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'21","last_scrub_stamp":"2024-03-23T23:58:36.253229+0000","last_deep_scrub":"24'21","last_deep_scrub_stamp":"2024-03-23T23:58:36.253229+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.253229+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:20.655417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'16","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.333823+0000","last_change":"2024-03-23T23:58:46.333877+0000","last_active":"2024-03-23T23:58:46.333823+0000","last_peered":"2024-03-23T23:58:46.333823+0000","last_clean":"2024-03-23T23:58:46.333823+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:58:46.333823+0000","last_undegraded":"2024-03-23T23:58:46.333823+0000","last_fullsized":"2024-03-23T23:58:46.333823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:46.333599+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:46.333599+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.333599+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:48:40.596353+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'26","reported_seq":53,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.669763+0000","last_change":"2024-03-23T23:58:33.669861+0000","last_active":"2024-03-23T23:58:33.669763+0000","last_peered":"2024-03-23T23:58:33.669763+0000","last_clean":"2024-03-23T23:58:33.669763+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:58:33.669763+0000","last_undegraded":"2024-03-23T23:58:33.669763+0000","last_fullsized":"2024-03-23T23:58:33.669763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'26","last_scrub_stamp":"2024-03-23T23:58:33.669529+0000","last_deep_scrub":"24'26","last_deep_scrub_stamp":"2024-03-23T23:58:33.669529+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.669529+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:28:12.406400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.680061+0000","last_change":"2024-03-23T23:58:33.680061+0000","last_active":"2024-03-23T23:58:33.680061+0000","last_peered":"2024-03-23T23:58:33.680061+0000","last_clean":"2024-03-23T23:58:33.680061+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:58:33.680061+0000","last_undegraded":"2024-03-23T23:58:33.680061+0000","last_fullsized":"2024-03-23T23:58:33.680061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:33.679693+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:33.679693+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.679693+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:25:23.249859+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.443740+0000","last_change":"2024-03-23T23:58:36.443740+0000","last_active":"2024-03-23T23:58:36.443740+0000","last_peered":"2024-03-23T23:58:36.443740+0000","last_clean":"2024-03-23T23:58:36.443740+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:58:36.443740+0000","last_undegraded":"2024-03-23T23:58:36.443740+0000","last_fullsized":"2024-03-23T23:58:36.443740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:36.443330+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:36.443330+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.443330+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:17.549051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'20","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.900402+0000","last_change":"2024-03-23T23:58:33.900402+0000","last_active":"2024-03-23T23:58:33.900402+0000","last_peered":"2024-03-23T23:58:33.900402+0000","last_clean":"2024-03-23T23:58:33.900402+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:58:33.900402+0000","last_undegraded":"2024-03-23T23:58:33.900402+0000","last_fullsized":"2024-03-23T23:58:33.900402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'20","last_scrub_stamp":"2024-03-23T23:58:33.900145+0000","last_deep_scrub":"24'20","last_deep_scrub_stamp":"2024-03-23T23:58:33.900145+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.900145+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:25:23.470311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'19","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.646091+0000","last_change":"2024-03-23T23:58:36.646155+0000","last_active":"2024-03-23T23:58:36.646091+0000","last_peered":"2024-03-23T23:58:36.646091+0000","last_clean":"2024-03-23T23:58:36.646091+0000","last_became_active":"2024-03-23T23:57:11.229498+0000","last_became_peered":"2024-03-23T23:57:11.229498+0000","last_unstale":"2024-03-23T23:58:36.646091+0000","last_undegraded":"2024-03-23T23:58:36.646091+0000","last_fullsized":"2024-03-23T23:58:36.646091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:36.645847+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:36.645847+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.645847+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:51.405110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.608326+0000","last_change":"2024-03-23T23:58:40.608326+0000","last_active":"2024-03-23T23:58:40.608326+0000","last_peered":"2024-03-23T23:58:40.608326+0000","last_clean":"2024-03-23T23:58:40.608326+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:58:40.608326+0000","last_undegraded":"2024-03-23T23:58:40.608326+0000","last_fullsized":"2024-03-23T23:58:40.608326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:40.608058+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:40.608058+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.608058+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:31:04.212675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.204811+0000","last_change":"2024-03-23T23:58:38.204811+0000","last_active":"2024-03-23T23:58:38.204811+0000","last_peered":"2024-03-23T23:58:38.204811+0000","last_clean":"2024-03-23T23:58:38.204811+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:58:38.204811+0000","last_undegraded":"2024-03-23T23:58:38.204811+0000","last_fullsized":"2024-03-23T23:58:38.204811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:38.204523+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:38.204523+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.204523+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:04:17.436858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'11","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.616385+0000","last_change":"2024-03-23T23:58:37.616385+0000","last_active":"2024-03-23T23:58:37.616385+0000","last_peered":"2024-03-23T23:58:37.616385+0000","last_clean":"2024-03-23T23:58:37.616385+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:58:37.616385+0000","last_undegraded":"2024-03-23T23:58:37.616385+0000","last_fullsized":"2024-03-23T23:58:37.616385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:37.616129+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:37.616129+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.616129+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:22.018318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'23","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.433565+0000","last_change":"2024-03-23T23:58:40.433565+0000","last_active":"2024-03-23T23:58:40.433565+0000","last_peered":"2024-03-23T23:58:40.433565+0000","last_clean":"2024-03-23T23:58:40.433565+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:58:40.433565+0000","last_undegraded":"2024-03-23T23:58:40.433565+0000","last_fullsized":"2024-03-23T23:58:40.433565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'23","last_scrub_stamp":"2024-03-23T23:58:40.433307+0000","last_deep_scrub":"24'23","last_deep_scrub_stamp":"2024-03-23T23:58:40.433307+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.433307+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:35.879266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'16","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.013493+0000","last_change":"2024-03-23T23:58:39.013493+0000","last_active":"2024-03-23T23:58:39.013493+0000","last_peered":"2024-03-23T23:58:39.013493+0000","last_clean":"2024-03-23T23:58:39.013493+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:58:39.013493+0000","last_undegraded":"2024-03-23T23:58:39.013493+0000","last_fullsized":"2024-03-23T23:58:39.013493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:39.013229+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:39.013229+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.013229+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:24.561863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.626586+0000","last_change":"2024-03-23T23:58:39.626586+0000","last_active":"2024-03-23T23:58:39.626586+0000","last_peered":"2024-03-23T23:58:39.626586+0000","last_clean":"2024-03-23T23:58:39.626586+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:58:39.626586+0000","last_undegraded":"2024-03-23T23:58:39.626586+0000","last_fullsized":"2024-03-23T23:58:39.626586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:39.626344+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:39.626344+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.626344+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:04:18.858679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'14","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.969762+0000","last_change":"2024-03-23T23:58:31.969762+0000","last_active":"2024-03-23T23:58:31.969762+0000","last_peered":"2024-03-23T23:58:31.969762+0000","last_clean":"2024-03-23T23:58:31.969762+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:58:31.969762+0000","last_undegraded":"2024-03-23T23:58:31.969762+0000","last_fullsized":"2024-03-23T23:58:31.969762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:31.969651+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:31.969651+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.969651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:45.369262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.219335+0000","last_change":"2024-03-23T23:58:37.219335+0000","last_active":"2024-03-23T23:58:37.219335+0000","last_peered":"2024-03-23T23:58:37.219335+0000","last_clean":"2024-03-23T23:58:37.219335+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:58:37.219335+0000","last_undegraded":"2024-03-23T23:58:37.219335+0000","last_fullsized":"2024-03-23T23:58:37.219335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:37.219065+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:37.219065+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.219065+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:54.843624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.692697+0000","last_change":"2024-03-23T23:58:32.692697+0000","last_active":"2024-03-23T23:58:32.692697+0000","last_peered":"2024-03-23T23:58:32.692697+0000","last_clean":"2024-03-23T23:58:32.692697+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:58:32.692697+0000","last_undegraded":"2024-03-23T23:58:32.692697+0000","last_fullsized":"2024-03-23T23:58:32.692697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:32.692288+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:32.692288+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.692288+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:50:42.260585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.489186+0000","last_change":"2024-03-23T23:58:38.489247+0000","last_active":"2024-03-23T23:58:38.489186+0000","last_peered":"2024-03-23T23:58:38.489186+0000","last_clean":"2024-03-23T23:58:38.489186+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:58:38.489186+0000","last_undegraded":"2024-03-23T23:58:38.489186+0000","last_fullsized":"2024-03-23T23:58:38.489186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:38.488947+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:38.488947+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.488947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:06:07.343622+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'18","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.009391+0000","last_change":"2024-03-23T23:58:32.009452+0000","last_active":"2024-03-23T23:58:32.009391+0000","last_peered":"2024-03-23T23:58:32.009391+0000","last_clean":"2024-03-23T23:58:32.009391+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:58:32.009391+0000","last_undegraded":"2024-03-23T23:58:32.009391+0000","last_fullsized":"2024-03-23T23:58:32.009391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:32.009195+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:32.009195+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.009195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:18.593423+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.651736+0000","last_change":"2024-03-23T23:58:31.651798+0000","last_active":"2024-03-23T23:58:31.651736+0000","last_peered":"2024-03-23T23:58:31.651736+0000","last_clean":"2024-03-23T23:58:31.651736+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:58:31.651736+0000","last_undegraded":"2024-03-23T23:58:31.651736+0000","last_fullsized":"2024-03-23T23:58:31.651736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-23T23:58:31.651623+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-23T23:58:31.651623+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.651623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:46.410886+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'17","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.856679+0000","last_change":"2024-03-23T23:58:34.856740+0000","last_active":"2024-03-23T23:58:34.856679+0000","last_peered":"2024-03-23T23:58:34.856679+0000","last_clean":"2024-03-23T23:58:34.856679+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:58:34.856679+0000","last_undegraded":"2024-03-23T23:58:34.856679+0000","last_fullsized":"2024-03-23T23:58:34.856679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:34.856476+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:34.856476+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.856476+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:28:34.522862+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.428657+0000","last_change":"2024-03-23T23:58:33.428748+0000","last_active":"2024-03-23T23:58:33.428657+0000","last_peered":"2024-03-23T23:58:33.428657+0000","last_clean":"2024-03-23T23:58:33.428657+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:58:33.428657+0000","last_undegraded":"2024-03-23T23:58:33.428657+0000","last_fullsized":"2024-03-23T23:58:33.428657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-23T23:58:33.428444+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-23T23:58:33.428444+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.428444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:02.789020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.612759+0000","last_change":"2024-03-23T23:58:29.612813+0000","last_active":"2024-03-23T23:58:29.612759+0000","last_peered":"2024-03-23T23:58:29.612759+0000","last_clean":"2024-03-23T23:58:29.612759+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:58:29.612759+0000","last_undegraded":"2024-03-23T23:58:29.612759+0000","last_fullsized":"2024-03-23T23:58:29.612759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:29.612569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:29.612569+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.612569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:17:58.973145+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'17","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.589059+0000","last_change":"2024-03-23T23:58:35.589169+0000","last_active":"2024-03-23T23:58:35.589059+0000","last_peered":"2024-03-23T23:58:35.589059+0000","last_clean":"2024-03-23T23:58:35.589059+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:58:35.589059+0000","last_undegraded":"2024-03-23T23:58:35.589059+0000","last_fullsized":"2024-03-23T23:58:35.589059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:35.588806+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:35.588806+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.588806+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:45.379394+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.225896+0000","last_change":"2024-03-23T23:58:35.225954+0000","last_active":"2024-03-23T23:58:35.225896+0000","last_peered":"2024-03-23T23:58:35.225896+0000","last_clean":"2024-03-23T23:58:35.225896+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:58:35.225896+0000","last_undegraded":"2024-03-23T23:58:35.225896+0000","last_fullsized":"2024-03-23T23:58:35.225896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:35.225672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:35.225672+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.225672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:30.671632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'18","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.025355+0000","last_change":"2024-03-23T23:58:37.025534+0000","last_active":"2024-03-23T23:58:37.025355+0000","last_peered":"2024-03-23T23:58:37.025355+0000","last_clean":"2024-03-23T23:58:37.025355+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:58:37.025355+0000","last_undegraded":"2024-03-23T23:58:37.025355+0000","last_fullsized":"2024-03-23T23:58:37.025355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:37.025043+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:37.025043+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.025043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:46.815632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.431634+0000","last_change":"2024-03-23T23:58:34.431697+0000","last_active":"2024-03-23T23:58:34.431634+0000","last_peered":"2024-03-23T23:58:34.431634+0000","last_clean":"2024-03-23T23:58:34.431634+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:58:34.431634+0000","last_undegraded":"2024-03-23T23:58:34.431634+0000","last_fullsized":"2024-03-23T23:58:34.431634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-03-23T23:58:34.431435+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-03-23T23:58:34.431435+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.431435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:44.779571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'17","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.289626+0000","last_change":"2024-03-23T23:58:44.289780+0000","last_active":"2024-03-23T23:58:44.289626+0000","last_peered":"2024-03-23T23:58:44.289626+0000","last_clean":"2024-03-23T23:58:44.289626+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:58:44.289626+0000","last_undegraded":"2024-03-23T23:58:44.289626+0000","last_fullsized":"2024-03-23T23:58:44.289626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:44.289298+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:44.289298+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.289298+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:08:07.247816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.280151+0000","last_change":"2024-03-23T23:58:32.280205+0000","last_active":"2024-03-23T23:58:32.280151+0000","last_peered":"2024-03-23T23:58:32.280151+0000","last_clean":"2024-03-23T23:58:32.280151+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:58:32.280151+0000","last_undegraded":"2024-03-23T23:58:32.280151+0000","last_fullsized":"2024-03-23T23:58:32.280151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:32.279945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:32.279945+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.279945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:06:56.613254+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'17","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.926252+0000","last_change":"2024-03-23T23:58:30.926292+0000","last_active":"2024-03-23T23:58:30.926252+0000","last_peered":"2024-03-23T23:58:30.926252+0000","last_clean":"2024-03-23T23:58:30.926252+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:58:30.926252+0000","last_undegraded":"2024-03-23T23:58:30.926252+0000","last_fullsized":"2024-03-23T23:58:30.926252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:30.926128+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:30.926128+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.926128+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:57:54.004086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'11","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.936400+0000","last_change":"2024-03-23T23:58:30.936464+0000","last_active":"2024-03-23T23:58:30.936400+0000","last_peered":"2024-03-23T23:58:30.936400+0000","last_clean":"2024-03-23T23:58:30.936400+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:58:30.936400+0000","last_undegraded":"2024-03-23T23:58:30.936400+0000","last_fullsized":"2024-03-23T23:58:30.936400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:30.936185+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:30.936185+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.936185+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:19:40.320786+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'19","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.051685+0000","last_change":"2024-03-23T23:58:33.051827+0000","last_active":"2024-03-23T23:58:33.051685+0000","last_peered":"2024-03-23T23:58:33.051685+0000","last_clean":"2024-03-23T23:58:33.051685+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:58:33.051685+0000","last_undegraded":"2024-03-23T23:58:33.051685+0000","last_fullsized":"2024-03-23T23:58:33.051685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:33.051454+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:33.051454+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.051454+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:18:18.912220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'123","reported_seq":152,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.463103+0000","last_change":"2024-03-23T23:58:32.463227+0000","last_active":"2024-03-23T23:58:32.463103+0000","last_peered":"2024-03-23T23:58:32.463103+0000","last_clean":"2024-03-23T23:58:32.463103+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:58:32.463103+0000","last_undegraded":"2024-03-23T23:58:32.463103+0000","last_fullsized":"2024-03-23T23:58:32.463103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'123","last_scrub_stamp":"2024-03-23T23:58:32.462892+0000","last_deep_scrub":"24'123","last_deep_scrub_stamp":"2024-03-23T23:58:32.462892+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.462892+0000","objects_scrubbed":4,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:28:11.199763+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'14","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.770614+0000","last_change":"2024-03-23T23:58:44.770725+0000","last_active":"2024-03-23T23:58:44.770614+0000","last_peered":"2024-03-23T23:58:44.770614+0000","last_clean":"2024-03-23T23:58:44.770614+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:58:44.770614+0000","last_undegraded":"2024-03-23T23:58:44.770614+0000","last_fullsized":"2024-03-23T23:58:44.770614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:44.770422+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:44.770422+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.770422+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:38:34.338503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'5","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.873052+0000","last_change":"2024-03-23T23:58:27.873143+0000","last_active":"2024-03-23T23:58:27.873052+0000","last_peered":"2024-03-23T23:58:27.873052+0000","last_clean":"2024-03-23T23:58:27.873052+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:58:27.873052+0000","last_undegraded":"2024-03-23T23:58:27.873052+0000","last_fullsized":"2024-03-23T23:58:27.873052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-03-23T23:58:27.872879+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-03-23T23:58:27.872879+0000","last_clean_scrub_stamp":"2024-03-23T23:58:27.872879+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:50:37.441177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'19","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.878055+0000","last_change":"2024-03-23T23:58:35.878125+0000","last_active":"2024-03-23T23:58:35.878055+0000","last_peered":"2024-03-23T23:58:35.878055+0000","last_clean":"2024-03-23T23:58:35.878055+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:58:35.878055+0000","last_undegraded":"2024-03-23T23:58:35.878055+0000","last_fullsized":"2024-03-23T23:58:35.878055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:35.877817+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:35.877817+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.877817+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:45.668406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.257019+0000","last_change":"2024-03-23T23:58:34.257075+0000","last_active":"2024-03-23T23:58:34.257019+0000","last_peered":"2024-03-23T23:58:34.257019+0000","last_clean":"2024-03-23T23:58:34.257019+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:58:34.257019+0000","last_undegraded":"2024-03-23T23:58:34.257019+0000","last_fullsized":"2024-03-23T23:58:34.257019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:34.256827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:34.256827+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.256827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:44.047416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'27","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:21.690258+0000","last_change":"2024-03-23T23:56:30.891637+0000","last_active":"2024-03-23T23:58:21.690258+0000","last_peered":"2024-03-23T23:58:21.690258+0000","last_clean":"2024-03-23T23:58:21.690258+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:58:21.690258+0000","last_undegraded":"2024-03-23T23:58:21.690258+0000","last_fullsized":"2024-03-23T23:58:21.690258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.409838+0000","last_change":"2024-03-23T23:58:35.409945+0000","last_active":"2024-03-23T23:58:35.409838+0000","last_peered":"2024-03-23T23:58:35.409838+0000","last_clean":"2024-03-23T23:58:35.409838+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:58:35.409838+0000","last_undegraded":"2024-03-23T23:58:35.409838+0000","last_fullsized":"2024-03-23T23:58:35.409838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:35.409423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:35.409423+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.409423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:50.168686+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'15","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.457022+0000","last_change":"2024-03-23T23:58:37.457142+0000","last_active":"2024-03-23T23:58:37.457022+0000","last_peered":"2024-03-23T23:58:37.457022+0000","last_clean":"2024-03-23T23:58:37.457022+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:58:37.457022+0000","last_undegraded":"2024-03-23T23:58:37.457022+0000","last_fullsized":"2024-03-23T23:58:37.457022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:37.456665+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:37.456665+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.456665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:07:01.789974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'12","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:28.729381+0000","last_change":"2024-03-23T23:58:28.729419+0000","last_active":"2024-03-23T23:58:28.729381+0000","last_peered":"2024-03-23T23:58:28.729381+0000","last_clean":"2024-03-23T23:58:28.729381+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:58:28.729381+0000","last_undegraded":"2024-03-23T23:58:28.729381+0000","last_fullsized":"2024-03-23T23:58:28.729381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-03-23T23:58:28.729300+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-03-23T23:58:28.729300+0000","last_clean_scrub_stamp":"2024-03-23T23:58:28.729300+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:45:05.884546+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'14","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.701281+0000","last_change":"2024-03-23T23:58:47.701340+0000","last_active":"2024-03-23T23:58:47.701281+0000","last_peered":"2024-03-23T23:58:47.701281+0000","last_clean":"2024-03-23T23:58:47.701281+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:58:47.701281+0000","last_undegraded":"2024-03-23T23:58:47.701281+0000","last_fullsized":"2024-03-23T23:58:47.701281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:47.701090+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:47.701090+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.701090+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:07.945038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.956804+0000","last_change":"2024-03-23T23:58:29.956804+0000","last_active":"2024-03-23T23:58:29.956804+0000","last_peered":"2024-03-23T23:58:29.956804+0000","last_clean":"2024-03-23T23:58:29.956804+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:58:29.956804+0000","last_undegraded":"2024-03-23T23:58:29.956804+0000","last_fullsized":"2024-03-23T23:58:29.956804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-03-23T23:58:29.956348+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-03-23T23:58:29.956348+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.956348+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:46:38.420794+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'12","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.929385+0000","last_change":"2024-03-23T23:56:30.890289+0000","last_active":"2024-03-23T23:58:31.929385+0000","last_peered":"2024-03-23T23:58:31.929385+0000","last_clean":"2024-03-23T23:58:31.929385+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:58:31.929385+0000","last_undegraded":"2024-03-23T23:58:31.929385+0000","last_fullsized":"2024-03-23T23:58:31.929385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:56:29.833606+0000","last_clean_scrub_stamp":"2024-03-23T23:56:29.833606+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.721054+0000","last_change":"2024-03-23T23:58:29.721054+0000","last_active":"2024-03-23T23:58:29.721054+0000","last_peered":"2024-03-23T23:58:29.721054+0000","last_clean":"2024-03-23T23:58:29.721054+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:58:29.721054+0000","last_undegraded":"2024-03-23T23:58:29.721054+0000","last_fullsized":"2024-03-23T23:58:29.721054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-03-23T23:58:29.720871+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-03-23T23:58:29.720871+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.720871+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:37:29.018890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'17","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.731310+0000","last_change":"2024-03-23T23:58:46.731310+0000","last_active":"2024-03-23T23:58:46.731310+0000","last_peered":"2024-03-23T23:58:46.731310+0000","last_clean":"2024-03-23T23:58:46.731310+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:58:46.731310+0000","last_undegraded":"2024-03-23T23:58:46.731310+0000","last_fullsized":"2024-03-23T23:58:46.731310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:46.730894+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:46.730894+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.730894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:41:12.138973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'2","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.951810+0000","last_change":"2024-03-23T23:58:32.951810+0000","last_active":"2024-03-23T23:58:32.951810+0000","last_peered":"2024-03-23T23:58:32.951810+0000","last_clean":"2024-03-23T23:58:32.951810+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:58:32.951810+0000","last_undegraded":"2024-03-23T23:58:32.951810+0000","last_fullsized":"2024-03-23T23:58:32.951810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-03-23T23:58:32.951544+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-03-23T23:58:32.951544+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.951544+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:47.710807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.232464+0000","last_change":"2024-03-23T23:58:39.232464+0000","last_active":"2024-03-23T23:58:39.232464+0000","last_peered":"2024-03-23T23:58:39.232464+0000","last_clean":"2024-03-23T23:58:39.232464+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:58:39.232464+0000","last_undegraded":"2024-03-23T23:58:39.232464+0000","last_fullsized":"2024-03-23T23:58:39.232464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:39.232061+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:39.232061+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.232061+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:31:02.836677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.727689+0000","last_change":"2024-03-23T23:58:31.727689+0000","last_active":"2024-03-23T23:58:31.727689+0000","last_peered":"2024-03-23T23:58:31.727689+0000","last_clean":"2024-03-23T23:58:31.727689+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:58:31.727689+0000","last_undegraded":"2024-03-23T23:58:31.727689+0000","last_fullsized":"2024-03-23T23:58:31.727689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:31.727579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:31.727579+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.727579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:25.235687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.706357+0000","last_change":"2024-03-23T23:58:32.706357+0000","last_active":"2024-03-23T23:58:32.706357+0000","last_peered":"2024-03-23T23:58:32.706357+0000","last_clean":"2024-03-23T23:58:32.706357+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:58:32.706357+0000","last_undegraded":"2024-03-23T23:58:32.706357+0000","last_fullsized":"2024-03-23T23:58:32.706357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:32.706078+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:32.706078+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.706078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:31:35.155657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.691902+0000","last_change":"2024-03-23T23:58:34.692054+0000","last_active":"2024-03-23T23:58:34.691902+0000","last_peered":"2024-03-23T23:58:34.691902+0000","last_clean":"2024-03-23T23:58:34.691902+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:58:34.691902+0000","last_undegraded":"2024-03-23T23:58:34.691902+0000","last_fullsized":"2024-03-23T23:58:34.691902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-03-23T23:58:34.691532+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-03-23T23:58:34.691532+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.691532+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:28:34.357918+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.314117+0000","last_change":"2024-03-23T23:58:31.314117+0000","last_active":"2024-03-23T23:58:31.314117+0000","last_peered":"2024-03-23T23:58:31.314117+0000","last_clean":"2024-03-23T23:58:31.314117+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:58:31.314117+0000","last_undegraded":"2024-03-23T23:58:31.314117+0000","last_fullsized":"2024-03-23T23:58:31.314117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:31.313889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:31.313889+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.313889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:12.419609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.568794+0000","last_change":"2024-03-23T23:58:36.568794+0000","last_active":"2024-03-23T23:58:36.568794+0000","last_peered":"2024-03-23T23:58:36.568794+0000","last_clean":"2024-03-23T23:58:36.568794+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:58:36.568794+0000","last_undegraded":"2024-03-23T23:58:36.568794+0000","last_fullsized":"2024-03-23T23:58:36.568794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:36.568383+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:36.568383+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.568383+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:32.219758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.681258+0000","last_change":"2024-03-23T23:58:36.681311+0000","last_active":"2024-03-23T23:58:36.681258+0000","last_peered":"2024-03-23T23:58:36.681258+0000","last_clean":"2024-03-23T23:58:36.681258+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:58:36.681258+0000","last_undegraded":"2024-03-23T23:58:36.681258+0000","last_fullsized":"2024-03-23T23:58:36.681258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:36.680989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:36.680989+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.680989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:32.332365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.876227+0000","last_change":"2024-03-23T23:58:36.876227+0000","last_active":"2024-03-23T23:58:36.876227+0000","last_peered":"2024-03-23T23:58:36.876227+0000","last_clean":"2024-03-23T23:58:36.876227+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:58:36.876227+0000","last_undegraded":"2024-03-23T23:58:36.876227+0000","last_fullsized":"2024-03-23T23:58:36.876227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:36.875719+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:36.875719+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.875719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:32.321679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'10","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.690454+0000","last_change":"2024-03-23T23:58:30.690454+0000","last_active":"2024-03-23T23:58:30.690454+0000","last_peered":"2024-03-23T23:58:30.690454+0000","last_clean":"2024-03-23T23:58:30.690454+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:58:30.690454+0000","last_undegraded":"2024-03-23T23:58:30.690454+0000","last_fullsized":"2024-03-23T23:58:30.690454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:30.690291+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:30.690291+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.690291+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:46:02.766236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'21","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.936967+0000","last_change":"2024-03-23T23:58:34.937076+0000","last_active":"2024-03-23T23:58:34.936967+0000","last_peered":"2024-03-23T23:58:34.936967+0000","last_clean":"2024-03-23T23:58:34.936967+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:58:34.936967+0000","last_undegraded":"2024-03-23T23:58:34.936967+0000","last_fullsized":"2024-03-23T23:58:34.936967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'21","last_scrub_stamp":"2024-03-23T23:58:34.936786+0000","last_deep_scrub":"24'21","last_deep_scrub_stamp":"2024-03-23T23:58:34.936786+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.936786+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:06:59.270095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.285440+0000","last_change":"2024-03-23T23:58:33.285440+0000","last_active":"2024-03-23T23:58:33.285440+0000","last_peered":"2024-03-23T23:58:33.285440+0000","last_clean":"2024-03-23T23:58:33.285440+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:58:33.285440+0000","last_undegraded":"2024-03-23T23:58:33.285440+0000","last_fullsized":"2024-03-23T23:58:33.285440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-03-23T23:58:33.285119+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-03-23T23:58:33.285119+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.285119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:06:02.139794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'11","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.089513+0000","last_change":"2024-03-23T23:58:35.089513+0000","last_active":"2024-03-23T23:58:35.089513+0000","last_peered":"2024-03-23T23:58:35.089513+0000","last_clean":"2024-03-23T23:58:35.089513+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:58:35.089513+0000","last_undegraded":"2024-03-23T23:58:35.089513+0000","last_fullsized":"2024-03-23T23:58:35.089513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:35.089262+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:35.089262+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.089262+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:16:23.986288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.894134+0000","last_change":"2024-03-23T23:58:27.894134+0000","last_active":"2024-03-23T23:58:27.894134+0000","last_peered":"2024-03-23T23:58:27.894134+0000","last_clean":"2024-03-23T23:58:27.894134+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:58:27.894134+0000","last_undegraded":"2024-03-23T23:58:27.894134+0000","last_fullsized":"2024-03-23T23:58:27.894134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:27.893788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:27.893788+0000","last_clean_scrub_stamp":"2024-03-23T23:58:27.893788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:21.401896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'13","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.225471+0000","last_change":"2024-03-23T23:58:41.225531+0000","last_active":"2024-03-23T23:58:41.225471+0000","last_peered":"2024-03-23T23:58:41.225471+0000","last_clean":"2024-03-23T23:58:41.225471+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:58:41.225471+0000","last_undegraded":"2024-03-23T23:58:41.225471+0000","last_fullsized":"2024-03-23T23:58:41.225471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-03-23T23:58:41.225290+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-03-23T23:58:41.225290+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.225290+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:25:53.131562+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.743748+0000","last_change":"2024-03-23T23:58:38.743848+0000","last_active":"2024-03-23T23:58:38.743748+0000","last_peered":"2024-03-23T23:58:38.743748+0000","last_clean":"2024-03-23T23:58:38.743748+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:58:38.743748+0000","last_undegraded":"2024-03-23T23:58:38.743748+0000","last_fullsized":"2024-03-23T23:58:38.743748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:38.743469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:38.743469+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.743469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:56.368028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'16","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.989293+0000","last_change":"2024-03-23T23:58:37.989293+0000","last_active":"2024-03-23T23:58:37.989293+0000","last_peered":"2024-03-23T23:58:37.989293+0000","last_clean":"2024-03-23T23:58:37.989293+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:58:37.989293+0000","last_undegraded":"2024-03-23T23:58:37.989293+0000","last_fullsized":"2024-03-23T23:58:37.989293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:37.989044+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:37.989044+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.989044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:33.435004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.957918+0000","last_change":"2024-03-23T23:58:29.957918+0000","last_active":"2024-03-23T23:58:29.957918+0000","last_peered":"2024-03-23T23:58:29.957918+0000","last_clean":"2024-03-23T23:58:29.957918+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:58:29.957918+0000","last_undegraded":"2024-03-23T23:58:29.957918+0000","last_fullsized":"2024-03-23T23:58:29.957918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-03-23T23:58:29.957813+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-03-23T23:58:29.957813+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.957813+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:28:08.694684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'15","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.662682+0000","last_change":"2024-03-23T23:58:35.662743+0000","last_active":"2024-03-23T23:58:35.662682+0000","last_peered":"2024-03-23T23:58:35.662682+0000","last_clean":"2024-03-23T23:58:35.662682+0000","last_became_active":"2024-03-23T23:57:11.227669+0000","last_became_peered":"2024-03-23T23:57:11.227669+0000","last_unstale":"2024-03-23T23:58:35.662682+0000","last_undegraded":"2024-03-23T23:58:35.662682+0000","last_fullsized":"2024-03-23T23:58:35.662682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:35.662480+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:35.662480+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.662480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:17:33.315116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.489042+0000","last_change":"2024-03-23T23:58:31.489042+0000","last_active":"2024-03-23T23:58:31.489042+0000","last_peered":"2024-03-23T23:58:31.489042+0000","last_clean":"2024-03-23T23:58:31.489042+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:58:31.489042+0000","last_undegraded":"2024-03-23T23:58:31.489042+0000","last_fullsized":"2024-03-23T23:58:31.489042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-03-23T23:58:31.488632+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-03-23T23:58:31.488632+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.488632+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:30:21.794055+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:28.889134+0000","last_change":"2024-03-23T23:58:28.889134+0000","last_active":"2024-03-23T23:58:28.889134+0000","last_peered":"2024-03-23T23:58:28.889134+0000","last_clean":"2024-03-23T23:58:28.889134+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:58:28.889134+0000","last_undegraded":"2024-03-23T23:58:28.889134+0000","last_fullsized":"2024-03-23T23:58:28.889134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:28.888851+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:28.888851+0000","last_clean_scrub_stamp":"2024-03-23T23:58:28.888851+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:31:04.548921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.704131+0000","last_change":"2024-03-23T23:58:37.704131+0000","last_active":"2024-03-23T23:58:37.704131+0000","last_peered":"2024-03-23T23:58:37.704131+0000","last_clean":"2024-03-23T23:58:37.704131+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:58:37.704131+0000","last_undegraded":"2024-03-23T23:58:37.704131+0000","last_fullsized":"2024-03-23T23:58:37.704131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:37.703865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:37.703865+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.703865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:22.106053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'7","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.056694+0000","last_change":"2024-03-23T23:58:34.056694+0000","last_active":"2024-03-23T23:58:34.056694+0000","last_peered":"2024-03-23T23:58:34.056694+0000","last_clean":"2024-03-23T23:58:34.056694+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:58:34.056694+0000","last_undegraded":"2024-03-23T23:58:34.056694+0000","last_fullsized":"2024-03-23T23:58:34.056694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-03-23T23:58:34.056436+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-03-23T23:58:34.056436+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.056436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:59:23.012665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.942115+0000","last_change":"2024-03-23T23:58:31.942115+0000","last_active":"2024-03-23T23:58:31.942115+0000","last_peered":"2024-03-23T23:58:31.942115+0000","last_clean":"2024-03-23T23:58:31.942115+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:58:31.942115+0000","last_undegraded":"2024-03-23T23:58:31.942115+0000","last_fullsized":"2024-03-23T23:58:31.942115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:31.941973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:31.941973+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.941973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:17:29.594609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'16","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.660933+0000","last_change":"2024-03-23T23:58:32.660933+0000","last_active":"2024-03-23T23:58:32.660933+0000","last_peered":"2024-03-23T23:58:32.660933+0000","last_clean":"2024-03-23T23:58:32.660933+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:58:32.660933+0000","last_undegraded":"2024-03-23T23:58:32.660933+0000","last_fullsized":"2024-03-23T23:58:32.660933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:32.660672+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:32.660672+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.660672+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:01:25.430105+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:28.927305+0000","last_change":"2024-03-23T23:58:28.927305+0000","last_active":"2024-03-23T23:58:28.927305+0000","last_peered":"2024-03-23T23:58:28.927305+0000","last_clean":"2024-03-23T23:58:28.927305+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:58:28.927305+0000","last_undegraded":"2024-03-23T23:58:28.927305+0000","last_fullsized":"2024-03-23T23:58:28.927305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:28.927166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:28.927166+0000","last_clean_scrub_stamp":"2024-03-23T23:58:28.927166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:50:38.495463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.640656+0000","last_change":"2024-03-23T23:58:38.640656+0000","last_active":"2024-03-23T23:58:38.640656+0000","last_peered":"2024-03-23T23:58:38.640656+0000","last_clean":"2024-03-23T23:58:38.640656+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:58:38.640656+0000","last_undegraded":"2024-03-23T23:58:38.640656+0000","last_fullsized":"2024-03-23T23:58:38.640656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:38.640394+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:38.640394+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.640394+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:56.264953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.782751+0000","last_change":"2024-03-23T23:58:40.782751+0000","last_active":"2024-03-23T23:58:40.782751+0000","last_peered":"2024-03-23T23:58:40.782751+0000","last_clean":"2024-03-23T23:58:40.782751+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:58:40.782751+0000","last_undegraded":"2024-03-23T23:58:40.782751+0000","last_fullsized":"2024-03-23T23:58:40.782751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-03-23T23:58:40.782483+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-03-23T23:58:40.782483+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.782483+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:31:04.387100+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'14","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.385529+0000","last_change":"2024-03-23T23:58:41.385529+0000","last_active":"2024-03-23T23:58:41.385529+0000","last_peered":"2024-03-23T23:58:41.385529+0000","last_clean":"2024-03-23T23:58:41.385529+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:58:41.385529+0000","last_undegraded":"2024-03-23T23:58:41.385529+0000","last_fullsized":"2024-03-23T23:58:41.385529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:41.385244+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:41.385244+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.385244+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:26.933877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'23","reported_seq":50,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.274786+0000","last_change":"2024-03-23T23:58:42.274856+0000","last_active":"2024-03-23T23:58:42.274786+0000","last_peered":"2024-03-23T23:58:42.274786+0000","last_clean":"2024-03-23T23:58:42.274786+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:58:42.274786+0000","last_undegraded":"2024-03-23T23:58:42.274786+0000","last_fullsized":"2024-03-23T23:58:42.274786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'23","last_scrub_stamp":"2024-03-23T23:58:42.274543+0000","last_deep_scrub":"24'23","last_deep_scrub_stamp":"2024-03-23T23:58:42.274543+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.274543+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:17.083362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'3","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.744895+0000","last_change":"2024-03-23T23:58:39.745034+0000","last_active":"2024-03-23T23:58:39.744895+0000","last_peered":"2024-03-23T23:58:39.744895+0000","last_clean":"2024-03-23T23:58:39.744895+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:58:39.744895+0000","last_undegraded":"2024-03-23T23:58:39.744895+0000","last_fullsized":"2024-03-23T23:58:39.744895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-03-23T23:58:39.744663+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-03-23T23:58:39.744663+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.744663+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:04:18.976998+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'13","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.257583+0000","last_change":"2024-03-23T23:58:40.257753+0000","last_active":"2024-03-23T23:58:40.257583+0000","last_peered":"2024-03-23T23:58:40.257583+0000","last_clean":"2024-03-23T23:58:40.257583+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:58:40.257583+0000","last_undegraded":"2024-03-23T23:58:40.257583+0000","last_fullsized":"2024-03-23T23:58:40.257583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-03-23T23:58:40.257297+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-03-23T23:58:40.257297+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.257297+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:00:42.598785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.701387+0000","last_change":"2024-03-23T23:58:35.701509+0000","last_active":"2024-03-23T23:58:35.701387+0000","last_peered":"2024-03-23T23:58:35.701387+0000","last_clean":"2024-03-23T23:58:35.701387+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:58:35.701387+0000","last_undegraded":"2024-03-23T23:58:35.701387+0000","last_fullsized":"2024-03-23T23:58:35.701387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-03-23T23:58:35.701083+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-03-23T23:58:35.701083+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.701083+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:45.491672+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'16","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.854192+0000","last_change":"2024-03-23T23:58:37.854192+0000","last_active":"2024-03-23T23:58:37.854192+0000","last_peered":"2024-03-23T23:58:37.854192+0000","last_clean":"2024-03-23T23:58:37.854192+0000","last_became_active":"2024-03-23T23:57:11.437365+0000","last_became_peered":"2024-03-23T23:57:11.437365+0000","last_unstale":"2024-03-23T23:58:37.854192+0000","last_undegraded":"2024-03-23T23:58:37.854192+0000","last_fullsized":"2024-03-23T23:58:37.854192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:37.853904+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:37.853904+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.853904+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:22.256092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.618510+0000","last_change":"2024-03-23T23:58:30.618510+0000","last_active":"2024-03-23T23:58:30.618510+0000","last_peered":"2024-03-23T23:58:30.618510+0000","last_clean":"2024-03-23T23:58:30.618510+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:58:30.618510+0000","last_undegraded":"2024-03-23T23:58:30.618510+0000","last_fullsized":"2024-03-23T23:58:30.618510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-23T23:58:30.618235+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-23T23:58:30.618235+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.618235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:17:28.270871+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'11","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.622778+0000","last_change":"2024-03-23T23:58:34.622906+0000","last_active":"2024-03-23T23:58:34.622778+0000","last_peered":"2024-03-23T23:58:34.622778+0000","last_clean":"2024-03-23T23:58:34.622778+0000","last_became_active":"2024-03-23T23:57:11.077960+0000","last_became_peered":"2024-03-23T23:57:11.077960+0000","last_unstale":"2024-03-23T23:58:34.622778+0000","last_undegraded":"2024-03-23T23:58:34.622778+0000","last_fullsized":"2024-03-23T23:58:34.622778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:34.622546+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:34.622546+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.622546+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:19:44.007147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:26.902590+0000","last_change":"2024-03-23T23:58:26.902590+0000","last_active":"2024-03-23T23:58:26.902590+0000","last_peered":"2024-03-23T23:58:26.902590+0000","last_clean":"2024-03-23T23:58:26.902590+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:58:26.902590+0000","last_undegraded":"2024-03-23T23:58:26.902590+0000","last_fullsized":"2024-03-23T23:58:26.902590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-03-23T23:58:26.902292+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-03-23T23:58:26.902292+0000","last_clean_scrub_stamp":"2024-03-23T23:58:26.902292+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:20.410400+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":42,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":148561,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":182,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":297122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":864256,"data_stored":684857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":240550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":93994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":94027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":241670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":95015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":94061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":684910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":147763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":146652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:58:52.945 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:52.946 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-23T23:56:29.833606+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=23, tm_min=58, tm_sec=24, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T23:58:52.946 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T23:59:12.948 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T23:59:13.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.181+0000 7f2fc0e00640 1 Processor -- start 2024-03-23T23:59:13.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.181+0000 7f2fc0e00640 1 -- start start 2024-03-23T23:59:13.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fc0e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc0b9a50 0x7f2fbc0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fc0e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2fbc0b5570 0x7f2fbc151b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fc0e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0b6930 con 0x7f2fbc0b2f70 2024-03-23T23:59:13.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fc0e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b8e50 con 0x7f2fbc0b5570 2024-03-23T23:59:13.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fc0e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b9e30 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fbbe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2fbc0b5570 0x7f2fbc151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fbbe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2fbc0b5570 0x7f2fbc151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58170/0 (socket says 172.21.15.31:58170) 2024-03-23T23:59:13.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.183+0000 7f2fbbe00640 1 -- 172.21.15.31:0/814929481 learned_addr learned my addr 172.21.15.31:0/814929481 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.184+0000 7f2fbb400640 1 --2- 172.21.15.31:0/814929481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc0b9a50 0x7f2fbc0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.184+0000 7f2fbbe00640 1 -- 172.21.15.31:0/814929481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc0b9a50 msgr2=0x7f2fbc0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.184+0000 7f2fbbe00640 1 --2- 172.21.15.31:0/814929481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc0b9a50 0x7f2fbc0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.184+0000 7f2fbbe00640 1 -- 172.21.15.31:0/814929481 >> v1:172.21.15.59:6789/0 conn(0x7f2fbc0b2f70 legacy=0x7f2fbc141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.184+0000 7f2fbbe00640 1 -- 172.21.15.31:0/814929481 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0b90a0 con 0x7f2fbc0b5570 2024-03-23T23:59:13.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.185+0000 7f2fbbe00640 1 --2- 172.21.15.31:0/814929481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b5570 0x7f2fbc151b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009870 tx=0x7f2fb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5501c9067c63cd2c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:13.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.185+0000 7f2fba000640 1 -- 172.21.15.31:0/814929481 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4035020 con 0x7f2fbc0b5570 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.185+0000 7f2fba000640 1 -- 172.21.15.31:0/814929481 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4031640 con 0x7f2fbc0b5570 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fba000640 1 -- 172.21.15.31:0/814929481 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb402d040 con 0x7f2fbc0b5570 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 -- 172.21.15.31:0/814929481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b5570 msgr2=0x7f2fbc151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/814929481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b5570 0x7f2fbc151b30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009870 tx=0x7f2fb402b8f0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 -- 172.21.15.31:0/814929481 shutdown_connections 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/814929481 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b5570 0x7f2fbc151b30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/814929481 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc0b9a50 0x7f2fbc0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 -- 172.21.15.31:0/814929481 >> 172.21.15.31:0/814929481 conn(0x7f2fbc066fb0 msgr2=0x7f2fbc067390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:13.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 -- 172.21.15.31:0/814929481 shutdown_connections 2024-03-23T23:59:13.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.186+0000 7f2fc0e00640 1 -- 172.21.15.31:0/814929481 wait complete. 2024-03-23T23:59:13.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.188+0000 7f2fc0e00640 1 Processor -- start 2024-03-23T23:59:13.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.188+0000 7f2fc0e00640 1 -- start start 2024-03-23T23:59:13.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fc0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc0b5570 0x7f2fbc142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fc0e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b9a50 0x7f2fbc144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fc0e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc1dd1e0 0x7f2fbc1dd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fc0e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b6ed0 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fc0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b6d50 con 0x7f2fbc0b5570 2024-03-23T23:59:13.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fc0e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc141870 con 0x7f2fbc1dd1e0 2024-03-23T23:59:13.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fbaa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b9a50 0x7f2fbc144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fbaa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b9a50 0x7f2fbc144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58176/0 (socket says 172.21.15.31:58176) 2024-03-23T23:59:13.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.189+0000 7f2fbaa00640 1 -- 172.21.15.31:0/2650782992 learned_addr learned my addr 172.21.15.31:0/2650782992 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:13.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fbaa00640 1 -- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc1dd1e0 msgr2=0x7f2fbc1dd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fbaa00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc1dd1e0 0x7f2fbc1dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fbaa00640 1 -- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc0b5570 msgr2=0x7f2fbc142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fbaa00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc0b5570 0x7f2fbc142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fbaa00640 1 -- 172.21.15.31:0/2650782992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc143aa0 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fbaa00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b9a50 0x7f2fbc144250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c7c0 tx=0x7f2fac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fb3400640 1 -- 172.21.15.31:0/2650782992 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac016020 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fb3400640 1 -- 172.21.15.31:0/2650782992 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac006d50 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc143d20 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fb3400640 1 -- 172.21.15.31:0/2650782992 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac003bb0 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.190+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc142f80 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.191+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc1dcd10 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.192+0000 7f2fb3400640 1 -- 172.21.15.31:0/2650782992 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2fac00a850 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.193+0000 7f2fb3400640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2f9806bbd0 0x7f2f9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.193+0000 7f2fb3400640 1 -- 172.21.15.31:0/2650782992 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f2fac08a840 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.194+0000 7f2fbb400640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2f9806bbd0 0x7f2f9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.195+0000 7f2fbb400640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2f9806bbd0 0x7f2f9806e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4006fd0 tx=0x7f2fa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:13.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.198+0000 7f2fb3400640 1 -- 172.21.15.31:0/2650782992 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f2fac020020 con 0x7f2fbc0b9a50 2024-03-23T23:59:13.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.400+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 --> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fbc13cbd0 con 0x7f2f9806bbd0 2024-03-23T23:59:13.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.419+0000 7f2fb3400640 1 -- 172.21.15.31:0/2650782992 <== mgr.4100 v2:172.21.15.59:6832/794111806 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252496 (secure 0 0 0) 0x7f2fbc13cbd0 con 0x7f2f9806bbd0 2024-03-23T23:59:13.423 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:59:13.424 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-03-23T23:59:13.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2f9806bbd0 msgr2=0x7f2f9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2f9806bbd0 0x7f2f9806e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4006fd0 tx=0x7f2fa4008040 comp rx=0 tx=0).stop 2024-03-23T23:59:13.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b9a50 msgr2=0x7f2fbc144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b9a50 0x7f2fbc144250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c7c0 tx=0x7f2fac00cc80 comp rx=0 tx=0).stop 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 shutdown_connections 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f2f9806bbd0 0x7f2f9806e090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fbc1dd1e0 0x7f2fbc1dd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2fbc0b9a50 0x7f2fbc144250 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 --2- 172.21.15.31:0/2650782992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fbc0b5570 0x7f2fbc142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 >> 172.21.15.31:0/2650782992 conn(0x7f2fbc066fb0 msgr2=0x7f2fbc0b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 shutdown_connections 2024-03-23T23:59:13.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.426+0000 7f2fc0e00640 1 -- 172.21.15.31:0/2650782992 wait complete. 2024-03-23T23:59:13.447 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-03-23T23:59:13.390622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":738950,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":125,"num_read_kb":109,"num_write":358,"num_write_kb":2666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1346,"ondisk_log_size":1346,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223840,"kb_used_data":3552,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750880,"statfs":{"total":773094113280,"available":772864901120,"internally_reserved":0,"allocated":3637248,"data_stored":2229084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004857"},"pg_stats":[{"pgid":"3.3f","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.763478+0000","last_change":"2024-03-23T23:58:45.763553+0000","last_active":"2024-03-23T23:58:45.763478+0000","last_peered":"2024-03-23T23:58:45.763478+0000","last_clean":"2024-03-23T23:58:45.763478+0000","last_became_active":"2024-03-23T23:56:30.880135+0000","last_became_peered":"2024-03-23T23:56:30.880135+0000","last_unstale":"2024-03-23T23:58:45.763478+0000","last_undegraded":"2024-03-23T23:58:45.763478+0000","last_fullsized":"2024-03-23T23:58:45.763478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:45.763262+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:45.763262+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.763262+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:24:13.336721+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.985305+0000","last_change":"2024-03-23T23:58:35.985305+0000","last_active":"2024-03-23T23:58:35.985305+0000","last_peered":"2024-03-23T23:58:35.985305+0000","last_clean":"2024-03-23T23:58:35.985305+0000","last_became_active":"2024-03-23T23:56:30.874906+0000","last_became_peered":"2024-03-23T23:56:30.874906+0000","last_unstale":"2024-03-23T23:58:35.985305+0000","last_undegraded":"2024-03-23T23:58:35.985305+0000","last_fullsized":"2024-03-23T23:58:35.985305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:35.984886+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:35.984886+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.984886+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:06:04.839561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.927749+0000","last_change":"2024-03-23T23:58:32.927749+0000","last_active":"2024-03-23T23:58:32.927749+0000","last_peered":"2024-03-23T23:58:32.927749+0000","last_clean":"2024-03-23T23:58:32.927749+0000","last_became_active":"2024-03-23T23:56:30.881413+0000","last_became_peered":"2024-03-23T23:56:30.881413+0000","last_unstale":"2024-03-23T23:58:32.927749+0000","last_undegraded":"2024-03-23T23:58:32.927749+0000","last_fullsized":"2024-03-23T23:58:32.927749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:32.927500+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:32.927500+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.927500+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:31:35.377079+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"24'12","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.301234+0000","last_change":"2024-03-23T23:58:43.301297+0000","last_active":"2024-03-23T23:58:43.301234+0000","last_peered":"2024-03-23T23:58:43.301234+0000","last_clean":"2024-03-23T23:58:43.301234+0000","last_became_active":"2024-03-23T23:56:30.890658+0000","last_became_peered":"2024-03-23T23:56:30.890658+0000","last_unstale":"2024-03-23T23:58:43.301234+0000","last_undegraded":"2024-03-23T23:58:43.301234+0000","last_fullsized":"2024-03-23T23:58:43.301234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-03-23T23:58:43.301025+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-03-23T23:58:43.301025+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.301025+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:21:18.105052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.826047+0000","last_change":"2024-03-23T23:58:41.826047+0000","last_active":"2024-03-23T23:58:41.826047+0000","last_peered":"2024-03-23T23:58:41.826047+0000","last_clean":"2024-03-23T23:58:41.826047+0000","last_became_active":"2024-03-23T23:56:30.876829+0000","last_became_peered":"2024-03-23T23:56:30.876829+0000","last_unstale":"2024-03-23T23:58:41.826047+0000","last_undegraded":"2024-03-23T23:58:41.826047+0000","last_fullsized":"2024-03-23T23:58:41.826047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:41.825783+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:41.825783+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.825783+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:06:24.371479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:45.300817+0000","last_change":"2024-03-23T23:58:45.300817+0000","last_active":"2024-03-23T23:58:45.300817+0000","last_peered":"2024-03-23T23:58:45.300817+0000","last_clean":"2024-03-23T23:58:45.300817+0000","last_became_active":"2024-03-23T23:56:30.889871+0000","last_became_peered":"2024-03-23T23:56:30.889871+0000","last_unstale":"2024-03-23T23:58:45.300817+0000","last_undegraded":"2024-03-23T23:58:45.300817+0000","last_fullsized":"2024-03-23T23:58:45.300817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:45.300286+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:45.300286+0000","last_clean_scrub_stamp":"2024-03-23T23:58:45.300286+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:41:10.708365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"24'11","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:43.816769+0000","last_change":"2024-03-23T23:58:43.816769+0000","last_active":"2024-03-23T23:58:43.816769+0000","last_peered":"2024-03-23T23:58:43.816769+0000","last_clean":"2024-03-23T23:58:43.816769+0000","last_became_active":"2024-03-23T23:56:30.884833+0000","last_became_peered":"2024-03-23T23:56:30.884833+0000","last_unstale":"2024-03-23T23:58:43.816769+0000","last_undegraded":"2024-03-23T23:58:43.816769+0000","last_fullsized":"2024-03-23T23:58:43.816769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:43.816306+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:43.816306+0000","last_clean_scrub_stamp":"2024-03-23T23:58:43.816306+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:18.625125+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.642625+0000","last_change":"2024-03-23T23:58:33.642625+0000","last_active":"2024-03-23T23:58:33.642625+0000","last_peered":"2024-03-23T23:58:33.642625+0000","last_clean":"2024-03-23T23:58:33.642625+0000","last_became_active":"2024-03-23T23:56:30.880685+0000","last_became_peered":"2024-03-23T23:56:30.880685+0000","last_unstale":"2024-03-23T23:58:33.642625+0000","last_undegraded":"2024-03-23T23:58:33.642625+0000","last_fullsized":"2024-03-23T23:58:33.642625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:33.642364+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:33.642364+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.642364+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:31:36.091943+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.837795+0000","last_change":"2024-03-23T23:58:42.837795+0000","last_active":"2024-03-23T23:58:42.837795+0000","last_peered":"2024-03-23T23:58:42.837795+0000","last_clean":"2024-03-23T23:58:42.837795+0000","last_became_active":"2024-03-23T23:56:30.883333+0000","last_became_peered":"2024-03-23T23:56:30.883333+0000","last_unstale":"2024-03-23T23:58:42.837795+0000","last_undegraded":"2024-03-23T23:58:42.837795+0000","last_fullsized":"2024-03-23T23:58:42.837795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:42.837349+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:42.837349+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.837349+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:25:54.743621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"24'26","reported_seq":54,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.408450+0000","last_change":"2024-03-23T23:58:42.408450+0000","last_active":"2024-03-23T23:58:42.408450+0000","last_peered":"2024-03-23T23:58:42.408450+0000","last_clean":"2024-03-23T23:58:42.408450+0000","last_became_active":"2024-03-23T23:56:30.879696+0000","last_became_peered":"2024-03-23T23:56:30.879696+0000","last_unstale":"2024-03-23T23:58:42.408450+0000","last_undegraded":"2024-03-23T23:58:42.408450+0000","last_fullsized":"2024-03-23T23:58:42.408450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'26","last_scrub_stamp":"2024-03-23T23:58:42.408193+0000","last_deep_scrub":"24'26","last_deep_scrub_stamp":"2024-03-23T23:58:42.408193+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.408193+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:45:52.164516+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"24'14","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.450942+0000","last_change":"2024-03-23T23:58:39.450942+0000","last_active":"2024-03-23T23:58:39.450942+0000","last_peered":"2024-03-23T23:58:39.450942+0000","last_clean":"2024-03-23T23:58:39.450942+0000","last_became_active":"2024-03-23T23:56:30.880742+0000","last_became_peered":"2024-03-23T23:56:30.880742+0000","last_unstale":"2024-03-23T23:58:39.450942+0000","last_undegraded":"2024-03-23T23:58:39.450942+0000","last_fullsized":"2024-03-23T23:58:39.450942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:39.450511+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:39.450511+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.450511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:53:57.741224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"24'12","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.977664+0000","last_change":"2024-03-23T23:58:30.977664+0000","last_active":"2024-03-23T23:58:30.977664+0000","last_peered":"2024-03-23T23:58:30.977664+0000","last_clean":"2024-03-23T23:58:30.977664+0000","last_became_active":"2024-03-23T23:56:30.862481+0000","last_became_peered":"2024-03-23T23:56:30.862481+0000","last_unstale":"2024-03-23T23:58:30.977664+0000","last_undegraded":"2024-03-23T23:58:30.977664+0000","last_fullsized":"2024-03-23T23:58:30.977664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-03-23T23:58:30.977385+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-03-23T23:58:30.977385+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.977385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:20:06.310483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.600672+0000","last_change":"2024-03-23T23:58:34.600672+0000","last_active":"2024-03-23T23:58:34.600672+0000","last_peered":"2024-03-23T23:58:34.600672+0000","last_clean":"2024-03-23T23:58:34.600672+0000","last_became_active":"2024-03-23T23:56:30.880831+0000","last_became_peered":"2024-03-23T23:56:30.880831+0000","last_unstale":"2024-03-23T23:58:34.600672+0000","last_undegraded":"2024-03-23T23:58:34.600672+0000","last_fullsized":"2024-03-23T23:58:34.600672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:34.600293+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:34.600293+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.600293+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:28:34.266679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"24'20","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.918807+0000","last_change":"2024-03-23T23:58:29.918807+0000","last_active":"2024-03-23T23:58:29.918807+0000","last_peered":"2024-03-23T23:58:29.918807+0000","last_clean":"2024-03-23T23:58:29.918807+0000","last_became_active":"2024-03-23T23:56:30.876303+0000","last_became_peered":"2024-03-23T23:56:30.876303+0000","last_unstale":"2024-03-23T23:58:29.918807+0000","last_undegraded":"2024-03-23T23:58:29.918807+0000","last_fullsized":"2024-03-23T23:58:29.918807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'20","last_scrub_stamp":"2024-03-23T23:58:29.918713+0000","last_deep_scrub":"24'20","last_deep_scrub_stamp":"2024-03-23T23:58:29.918713+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.918713+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:40.266849+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"24'17","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.982034+0000","last_change":"2024-03-23T23:58:33.982034+0000","last_active":"2024-03-23T23:58:33.982034+0000","last_peered":"2024-03-23T23:58:33.982034+0000","last_clean":"2024-03-23T23:58:33.982034+0000","last_became_active":"2024-03-23T23:56:30.861920+0000","last_became_peered":"2024-03-23T23:56:30.861920+0000","last_unstale":"2024-03-23T23:58:33.982034+0000","last_undegraded":"2024-03-23T23:58:33.982034+0000","last_fullsized":"2024-03-23T23:58:33.982034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:33.981604+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:33.981604+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.981604+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:15.087325+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"24'21","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.253644+0000","last_change":"2024-03-23T23:58:36.253644+0000","last_active":"2024-03-23T23:58:36.253644+0000","last_peered":"2024-03-23T23:58:36.253644+0000","last_clean":"2024-03-23T23:58:36.253644+0000","last_became_active":"2024-03-23T23:56:30.882666+0000","last_became_peered":"2024-03-23T23:56:30.882666+0000","last_unstale":"2024-03-23T23:58:36.253644+0000","last_undegraded":"2024-03-23T23:58:36.253644+0000","last_fullsized":"2024-03-23T23:58:36.253644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'21","last_scrub_stamp":"2024-03-23T23:58:36.253229+0000","last_deep_scrub":"24'21","last_deep_scrub_stamp":"2024-03-23T23:58:36.253229+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.253229+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:20.655417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"24'16","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.333877+0000","last_change":"2024-03-23T23:58:46.333877+0000","last_active":"2024-03-23T23:58:46.333877+0000","last_peered":"2024-03-23T23:58:46.333877+0000","last_clean":"2024-03-23T23:58:46.333877+0000","last_became_active":"2024-03-23T23:56:30.893641+0000","last_became_peered":"2024-03-23T23:56:30.893641+0000","last_unstale":"2024-03-23T23:58:46.333877+0000","last_undegraded":"2024-03-23T23:58:46.333877+0000","last_fullsized":"2024-03-23T23:58:46.333877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:46.333599+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:46.333599+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.333599+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:48:40.596353+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"24'26","reported_seq":54,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.669861+0000","last_change":"2024-03-23T23:58:33.669861+0000","last_active":"2024-03-23T23:58:33.669861+0000","last_peered":"2024-03-23T23:58:33.669861+0000","last_clean":"2024-03-23T23:58:33.669861+0000","last_became_active":"2024-03-23T23:56:30.891849+0000","last_became_peered":"2024-03-23T23:56:30.891849+0000","last_unstale":"2024-03-23T23:58:33.669861+0000","last_undegraded":"2024-03-23T23:58:33.669861+0000","last_fullsized":"2024-03-23T23:58:33.669861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'26","last_scrub_stamp":"2024-03-23T23:58:33.669529+0000","last_deep_scrub":"24'26","last_deep_scrub_stamp":"2024-03-23T23:58:33.669529+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.669529+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:28:12.406400+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.680061+0000","last_change":"2024-03-23T23:58:33.680061+0000","last_active":"2024-03-23T23:58:33.680061+0000","last_peered":"2024-03-23T23:58:33.680061+0000","last_clean":"2024-03-23T23:58:33.680061+0000","last_became_active":"2024-03-23T23:56:30.878211+0000","last_became_peered":"2024-03-23T23:56:30.878211+0000","last_unstale":"2024-03-23T23:58:33.680061+0000","last_undegraded":"2024-03-23T23:58:33.680061+0000","last_fullsized":"2024-03-23T23:58:33.680061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:33.679693+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:33.679693+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.679693+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:25:23.249859+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.443740+0000","last_change":"2024-03-23T23:58:36.443740+0000","last_active":"2024-03-23T23:58:36.443740+0000","last_peered":"2024-03-23T23:58:36.443740+0000","last_clean":"2024-03-23T23:58:36.443740+0000","last_became_active":"2024-03-23T23:56:30.875111+0000","last_became_peered":"2024-03-23T23:56:30.875111+0000","last_unstale":"2024-03-23T23:58:36.443740+0000","last_undegraded":"2024-03-23T23:58:36.443740+0000","last_fullsized":"2024-03-23T23:58:36.443740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:36.443330+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:36.443330+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.443330+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:17.549051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"24'20","reported_seq":48,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.900402+0000","last_change":"2024-03-23T23:58:33.900402+0000","last_active":"2024-03-23T23:58:33.900402+0000","last_peered":"2024-03-23T23:58:33.900402+0000","last_clean":"2024-03-23T23:58:33.900402+0000","last_became_active":"2024-03-23T23:56:30.882579+0000","last_became_peered":"2024-03-23T23:56:30.882579+0000","last_unstale":"2024-03-23T23:58:33.900402+0000","last_undegraded":"2024-03-23T23:58:33.900402+0000","last_fullsized":"2024-03-23T23:58:33.900402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'20","last_scrub_stamp":"2024-03-23T23:58:33.900145+0000","last_deep_scrub":"24'20","last_deep_scrub_stamp":"2024-03-23T23:58:33.900145+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.900145+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:25:23.470311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"24'19","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.646091+0000","last_change":"2024-03-23T23:58:36.646155+0000","last_active":"2024-03-23T23:58:36.646091+0000","last_peered":"2024-03-23T23:58:36.646091+0000","last_clean":"2024-03-23T23:58:36.646091+0000","last_became_active":"2024-03-23T23:57:11.229498+0000","last_became_peered":"2024-03-23T23:57:11.229498+0000","last_unstale":"2024-03-23T23:58:36.646091+0000","last_undegraded":"2024-03-23T23:58:36.646091+0000","last_fullsized":"2024-03-23T23:58:36.646091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:36.645847+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:36.645847+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.645847+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:51.405110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.608326+0000","last_change":"2024-03-23T23:58:40.608326+0000","last_active":"2024-03-23T23:58:40.608326+0000","last_peered":"2024-03-23T23:58:40.608326+0000","last_clean":"2024-03-23T23:58:40.608326+0000","last_became_active":"2024-03-23T23:56:30.887691+0000","last_became_peered":"2024-03-23T23:56:30.887691+0000","last_unstale":"2024-03-23T23:58:40.608326+0000","last_undegraded":"2024-03-23T23:58:40.608326+0000","last_fullsized":"2024-03-23T23:58:40.608326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:40.608058+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:40.608058+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.608058+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:31:04.212675+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.204811+0000","last_change":"2024-03-23T23:58:38.204811+0000","last_active":"2024-03-23T23:58:38.204811+0000","last_peered":"2024-03-23T23:58:38.204811+0000","last_clean":"2024-03-23T23:58:38.204811+0000","last_became_active":"2024-03-23T23:56:30.886111+0000","last_became_peered":"2024-03-23T23:56:30.886111+0000","last_unstale":"2024-03-23T23:58:38.204811+0000","last_undegraded":"2024-03-23T23:58:38.204811+0000","last_fullsized":"2024-03-23T23:58:38.204811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:38.204523+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:38.204523+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.204523+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:04:17.436858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"24'11","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.616385+0000","last_change":"2024-03-23T23:58:37.616385+0000","last_active":"2024-03-23T23:58:37.616385+0000","last_peered":"2024-03-23T23:58:37.616385+0000","last_clean":"2024-03-23T23:58:37.616385+0000","last_became_active":"2024-03-23T23:56:30.885147+0000","last_became_peered":"2024-03-23T23:56:30.885147+0000","last_unstale":"2024-03-23T23:58:37.616385+0000","last_undegraded":"2024-03-23T23:58:37.616385+0000","last_fullsized":"2024-03-23T23:58:37.616385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:37.616129+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:37.616129+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.616129+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:22.018318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"24'23","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.433565+0000","last_change":"2024-03-23T23:58:40.433565+0000","last_active":"2024-03-23T23:58:40.433565+0000","last_peered":"2024-03-23T23:58:40.433565+0000","last_clean":"2024-03-23T23:58:40.433565+0000","last_became_active":"2024-03-23T23:56:30.879033+0000","last_became_peered":"2024-03-23T23:56:30.879033+0000","last_unstale":"2024-03-23T23:58:40.433565+0000","last_undegraded":"2024-03-23T23:58:40.433565+0000","last_fullsized":"2024-03-23T23:58:40.433565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'23","last_scrub_stamp":"2024-03-23T23:58:40.433307+0000","last_deep_scrub":"24'23","last_deep_scrub_stamp":"2024-03-23T23:58:40.433307+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.433307+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:35.879266+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"24'16","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.013493+0000","last_change":"2024-03-23T23:58:39.013493+0000","last_active":"2024-03-23T23:58:39.013493+0000","last_peered":"2024-03-23T23:58:39.013493+0000","last_clean":"2024-03-23T23:58:39.013493+0000","last_became_active":"2024-03-23T23:56:30.880672+0000","last_became_peered":"2024-03-23T23:56:30.880672+0000","last_unstale":"2024-03-23T23:58:39.013493+0000","last_undegraded":"2024-03-23T23:58:39.013493+0000","last_fullsized":"2024-03-23T23:58:39.013493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:39.013229+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:39.013229+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.013229+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:24.561863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.626586+0000","last_change":"2024-03-23T23:58:39.626586+0000","last_active":"2024-03-23T23:58:39.626586+0000","last_peered":"2024-03-23T23:58:39.626586+0000","last_clean":"2024-03-23T23:58:39.626586+0000","last_became_active":"2024-03-23T23:56:30.887657+0000","last_became_peered":"2024-03-23T23:56:30.887657+0000","last_unstale":"2024-03-23T23:58:39.626586+0000","last_undegraded":"2024-03-23T23:58:39.626586+0000","last_fullsized":"2024-03-23T23:58:39.626586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:39.626344+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:39.626344+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.626344+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:04:18.858679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"24'14","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.969762+0000","last_change":"2024-03-23T23:58:31.969762+0000","last_active":"2024-03-23T23:58:31.969762+0000","last_peered":"2024-03-23T23:58:31.969762+0000","last_clean":"2024-03-23T23:58:31.969762+0000","last_became_active":"2024-03-23T23:56:30.879610+0000","last_became_peered":"2024-03-23T23:56:30.879610+0000","last_unstale":"2024-03-23T23:58:31.969762+0000","last_undegraded":"2024-03-23T23:58:31.969762+0000","last_fullsized":"2024-03-23T23:58:31.969762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:31.969651+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:31.969651+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.969651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:21:45.369262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.219335+0000","last_change":"2024-03-23T23:58:37.219335+0000","last_active":"2024-03-23T23:58:37.219335+0000","last_peered":"2024-03-23T23:58:37.219335+0000","last_clean":"2024-03-23T23:58:37.219335+0000","last_became_active":"2024-03-23T23:56:30.885157+0000","last_became_peered":"2024-03-23T23:56:30.885157+0000","last_unstale":"2024-03-23T23:58:37.219335+0000","last_undegraded":"2024-03-23T23:58:37.219335+0000","last_fullsized":"2024-03-23T23:58:37.219335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:37.219065+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:37.219065+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.219065+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:54.843624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.692697+0000","last_change":"2024-03-23T23:58:32.692697+0000","last_active":"2024-03-23T23:58:32.692697+0000","last_peered":"2024-03-23T23:58:32.692697+0000","last_clean":"2024-03-23T23:58:32.692697+0000","last_became_active":"2024-03-23T23:56:30.879847+0000","last_became_peered":"2024-03-23T23:56:30.879847+0000","last_unstale":"2024-03-23T23:58:32.692697+0000","last_undegraded":"2024-03-23T23:58:32.692697+0000","last_fullsized":"2024-03-23T23:58:32.692697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:32.692288+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:32.692288+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.692288+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:50:42.260585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.489186+0000","last_change":"2024-03-23T23:58:38.489247+0000","last_active":"2024-03-23T23:58:38.489186+0000","last_peered":"2024-03-23T23:58:38.489186+0000","last_clean":"2024-03-23T23:58:38.489186+0000","last_became_active":"2024-03-23T23:56:30.880103+0000","last_became_peered":"2024-03-23T23:56:30.880103+0000","last_unstale":"2024-03-23T23:58:38.489186+0000","last_undegraded":"2024-03-23T23:58:38.489186+0000","last_fullsized":"2024-03-23T23:58:38.489186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:38.488947+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:38.488947+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.488947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:06:07.343622+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.009452+0000","last_change":"2024-03-23T23:58:32.009452+0000","last_active":"2024-03-23T23:58:32.009452+0000","last_peered":"2024-03-23T23:58:32.009452+0000","last_clean":"2024-03-23T23:58:32.009452+0000","last_became_active":"2024-03-23T23:56:30.867440+0000","last_became_peered":"2024-03-23T23:56:30.867440+0000","last_unstale":"2024-03-23T23:58:32.009452+0000","last_undegraded":"2024-03-23T23:58:32.009452+0000","last_fullsized":"2024-03-23T23:58:32.009452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:32.009195+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:32.009195+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.009195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:12:18.593423+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.651798+0000","last_change":"2024-03-23T23:58:31.651798+0000","last_active":"2024-03-23T23:58:31.651798+0000","last_peered":"2024-03-23T23:58:31.651798+0000","last_clean":"2024-03-23T23:58:31.651798+0000","last_became_active":"2024-03-23T23:56:29.890198+0000","last_became_peered":"2024-03-23T23:56:29.890198+0000","last_unstale":"2024-03-23T23:58:31.651798+0000","last_undegraded":"2024-03-23T23:58:31.651798+0000","last_fullsized":"2024-03-23T23:58:31.651798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-23T23:58:31.651623+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-23T23:58:31.651623+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.651623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:46.410886+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"24'17","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.856740+0000","last_change":"2024-03-23T23:58:34.856740+0000","last_active":"2024-03-23T23:58:34.856740+0000","last_peered":"2024-03-23T23:58:34.856740+0000","last_clean":"2024-03-23T23:58:34.856740+0000","last_became_active":"2024-03-23T23:56:30.884589+0000","last_became_peered":"2024-03-23T23:56:30.884589+0000","last_unstale":"2024-03-23T23:58:34.856740+0000","last_undegraded":"2024-03-23T23:58:34.856740+0000","last_fullsized":"2024-03-23T23:58:34.856740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:34.856476+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:34.856476+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.856476+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:28:34.522862+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.428748+0000","last_change":"2024-03-23T23:58:33.428748+0000","last_active":"2024-03-23T23:58:33.428748+0000","last_peered":"2024-03-23T23:58:33.428748+0000","last_clean":"2024-03-23T23:58:33.428748+0000","last_became_active":"2024-03-23T23:56:29.891987+0000","last_became_peered":"2024-03-23T23:56:29.891987+0000","last_unstale":"2024-03-23T23:58:33.428748+0000","last_undegraded":"2024-03-23T23:58:33.428748+0000","last_fullsized":"2024-03-23T23:58:33.428748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-23T23:58:33.428444+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-23T23:58:33.428444+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.428444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:18:02.789020+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.612813+0000","last_change":"2024-03-23T23:58:29.612813+0000","last_active":"2024-03-23T23:58:29.612813+0000","last_peered":"2024-03-23T23:58:29.612813+0000","last_clean":"2024-03-23T23:58:29.612813+0000","last_became_active":"2024-03-23T23:56:29.886416+0000","last_became_peered":"2024-03-23T23:56:29.886416+0000","last_unstale":"2024-03-23T23:58:29.612813+0000","last_undegraded":"2024-03-23T23:58:29.612813+0000","last_fullsized":"2024-03-23T23:58:29.612813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:29.612569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:29.612569+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.612569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:17:58.973145+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"24'17","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.589169+0000","last_change":"2024-03-23T23:58:35.589169+0000","last_active":"2024-03-23T23:58:35.589169+0000","last_peered":"2024-03-23T23:58:35.589169+0000","last_clean":"2024-03-23T23:58:35.589169+0000","last_became_active":"2024-03-23T23:56:30.881092+0000","last_became_peered":"2024-03-23T23:56:30.881092+0000","last_unstale":"2024-03-23T23:58:35.589169+0000","last_undegraded":"2024-03-23T23:58:35.589169+0000","last_fullsized":"2024-03-23T23:58:35.589169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:35.588806+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:35.588806+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.588806+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:45.379394+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.225954+0000","last_change":"2024-03-23T23:58:35.225954+0000","last_active":"2024-03-23T23:58:35.225954+0000","last_peered":"2024-03-23T23:58:35.225954+0000","last_clean":"2024-03-23T23:58:35.225954+0000","last_became_active":"2024-03-23T23:56:29.896942+0000","last_became_peered":"2024-03-23T23:56:29.896942+0000","last_unstale":"2024-03-23T23:58:35.225954+0000","last_undegraded":"2024-03-23T23:58:35.225954+0000","last_fullsized":"2024-03-23T23:58:35.225954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:35.225672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:35.225672+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.225672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:30.671632+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.025534+0000","last_change":"2024-03-23T23:58:37.025534+0000","last_active":"2024-03-23T23:58:37.025534+0000","last_peered":"2024-03-23T23:58:37.025534+0000","last_clean":"2024-03-23T23:58:37.025534+0000","last_became_active":"2024-03-23T23:56:30.876279+0000","last_became_peered":"2024-03-23T23:56:30.876279+0000","last_unstale":"2024-03-23T23:58:37.025534+0000","last_undegraded":"2024-03-23T23:58:37.025534+0000","last_fullsized":"2024-03-23T23:58:37.025534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:37.025043+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:37.025043+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.025043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:46.815632+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"23'1","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.431697+0000","last_change":"2024-03-23T23:58:34.431697+0000","last_active":"2024-03-23T23:58:34.431697+0000","last_peered":"2024-03-23T23:58:34.431697+0000","last_clean":"2024-03-23T23:58:34.431697+0000","last_became_active":"2024-03-23T23:56:29.894219+0000","last_became_peered":"2024-03-23T23:56:29.894219+0000","last_unstale":"2024-03-23T23:58:34.431697+0000","last_undegraded":"2024-03-23T23:58:34.431697+0000","last_fullsized":"2024-03-23T23:58:34.431697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2024-03-23T23:58:34.431435+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2024-03-23T23:58:34.431435+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.431435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:52:44.779571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"24'17","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.289780+0000","last_change":"2024-03-23T23:58:44.289780+0000","last_active":"2024-03-23T23:58:44.289780+0000","last_peered":"2024-03-23T23:58:44.289780+0000","last_clean":"2024-03-23T23:58:44.289780+0000","last_became_active":"2024-03-23T23:56:30.891042+0000","last_became_peered":"2024-03-23T23:56:30.891042+0000","last_unstale":"2024-03-23T23:58:44.289780+0000","last_undegraded":"2024-03-23T23:58:44.289780+0000","last_fullsized":"2024-03-23T23:58:44.289780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:44.289298+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:44.289298+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.289298+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:08:07.247816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.280205+0000","last_change":"2024-03-23T23:58:32.280205+0000","last_active":"2024-03-23T23:58:32.280205+0000","last_peered":"2024-03-23T23:58:32.280205+0000","last_clean":"2024-03-23T23:58:32.280205+0000","last_became_active":"2024-03-23T23:56:29.885995+0000","last_became_peered":"2024-03-23T23:56:29.885995+0000","last_unstale":"2024-03-23T23:58:32.280205+0000","last_undegraded":"2024-03-23T23:58:32.280205+0000","last_fullsized":"2024-03-23T23:58:32.280205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:32.279945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:32.279945+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.279945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:06:56.613254+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"24'17","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.926292+0000","last_change":"2024-03-23T23:58:30.926292+0000","last_active":"2024-03-23T23:58:30.926292+0000","last_peered":"2024-03-23T23:58:30.926292+0000","last_clean":"2024-03-23T23:58:30.926292+0000","last_became_active":"2024-03-23T23:56:30.876570+0000","last_became_peered":"2024-03-23T23:56:30.876570+0000","last_unstale":"2024-03-23T23:58:30.926292+0000","last_undegraded":"2024-03-23T23:58:30.926292+0000","last_fullsized":"2024-03-23T23:58:30.926292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:30.926128+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:30.926128+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.926128+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:57:54.004086+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"24'11","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.936464+0000","last_change":"2024-03-23T23:58:30.936464+0000","last_active":"2024-03-23T23:58:30.936464+0000","last_peered":"2024-03-23T23:58:30.936464+0000","last_clean":"2024-03-23T23:58:30.936464+0000","last_became_active":"2024-03-23T23:56:29.886328+0000","last_became_peered":"2024-03-23T23:56:29.886328+0000","last_unstale":"2024-03-23T23:58:30.936464+0000","last_undegraded":"2024-03-23T23:58:30.936464+0000","last_fullsized":"2024-03-23T23:58:30.936464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:30.936185+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:30.936185+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.936185+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:19:40.320786+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.051827+0000","last_change":"2024-03-23T23:58:33.051827+0000","last_active":"2024-03-23T23:58:33.051827+0000","last_peered":"2024-03-23T23:58:33.051827+0000","last_clean":"2024-03-23T23:58:33.051827+0000","last_became_active":"2024-03-23T23:56:30.870798+0000","last_became_peered":"2024-03-23T23:56:30.870798+0000","last_unstale":"2024-03-23T23:58:33.051827+0000","last_undegraded":"2024-03-23T23:58:33.051827+0000","last_fullsized":"2024-03-23T23:58:33.051827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:33.051454+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:33.051454+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.051454+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:18:18.912220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"24'123","reported_seq":153,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.463227+0000","last_change":"2024-03-23T23:58:32.463227+0000","last_active":"2024-03-23T23:58:32.463227+0000","last_peered":"2024-03-23T23:58:32.463227+0000","last_clean":"2024-03-23T23:58:32.463227+0000","last_became_active":"2024-03-23T23:56:29.885933+0000","last_became_peered":"2024-03-23T23:56:29.885933+0000","last_unstale":"2024-03-23T23:58:32.463227+0000","last_undegraded":"2024-03-23T23:58:32.463227+0000","last_fullsized":"2024-03-23T23:58:32.463227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'123","last_scrub_stamp":"2024-03-23T23:58:32.462892+0000","last_deep_scrub":"24'123","last_deep_scrub_stamp":"2024-03-23T23:58:32.462892+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.462892+0000","objects_scrubbed":4,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:28:11.199763+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"24'14","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:44.770725+0000","last_change":"2024-03-23T23:58:44.770725+0000","last_active":"2024-03-23T23:58:44.770725+0000","last_peered":"2024-03-23T23:58:44.770725+0000","last_clean":"2024-03-23T23:58:44.770725+0000","last_became_active":"2024-03-23T23:56:30.885377+0000","last_became_peered":"2024-03-23T23:56:30.885377+0000","last_unstale":"2024-03-23T23:58:44.770725+0000","last_undegraded":"2024-03-23T23:58:44.770725+0000","last_fullsized":"2024-03-23T23:58:44.770725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:44.770422+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:44.770422+0000","last_clean_scrub_stamp":"2024-03-23T23:58:44.770422+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:38:34.338503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"24'5","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.873143+0000","last_change":"2024-03-23T23:58:27.873143+0000","last_active":"2024-03-23T23:58:27.873143+0000","last_peered":"2024-03-23T23:58:27.873143+0000","last_clean":"2024-03-23T23:58:27.873143+0000","last_became_active":"2024-03-23T23:56:29.890906+0000","last_became_peered":"2024-03-23T23:56:29.890906+0000","last_unstale":"2024-03-23T23:58:27.873143+0000","last_undegraded":"2024-03-23T23:58:27.873143+0000","last_fullsized":"2024-03-23T23:58:27.873143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'5","last_scrub_stamp":"2024-03-23T23:58:27.872879+0000","last_deep_scrub":"24'5","last_deep_scrub_stamp":"2024-03-23T23:58:27.872879+0000","last_clean_scrub_stamp":"2024-03-23T23:58:27.872879+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:50:37.441177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.878125+0000","last_change":"2024-03-23T23:58:35.878125+0000","last_active":"2024-03-23T23:58:35.878125+0000","last_peered":"2024-03-23T23:58:35.878125+0000","last_clean":"2024-03-23T23:58:35.878125+0000","last_became_active":"2024-03-23T23:56:30.885171+0000","last_became_peered":"2024-03-23T23:56:30.885171+0000","last_unstale":"2024-03-23T23:58:35.878125+0000","last_undegraded":"2024-03-23T23:58:35.878125+0000","last_fullsized":"2024-03-23T23:58:35.878125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:35.877817+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:35.877817+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.877817+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:45.668406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.257075+0000","last_change":"2024-03-23T23:58:34.257075+0000","last_active":"2024-03-23T23:58:34.257075+0000","last_peered":"2024-03-23T23:58:34.257075+0000","last_clean":"2024-03-23T23:58:34.257075+0000","last_became_active":"2024-03-23T23:56:29.890157+0000","last_became_peered":"2024-03-23T23:56:29.890157+0000","last_unstale":"2024-03-23T23:58:34.257075+0000","last_undegraded":"2024-03-23T23:58:34.257075+0000","last_fullsized":"2024-03-23T23:58:34.257075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:34.256827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:34.256827+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.256827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:44.047416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'27","reported_seq":55,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:49.730772+0000","last_change":"2024-03-23T23:58:49.730772+0000","last_active":"2024-03-23T23:58:49.730772+0000","last_peered":"2024-03-23T23:58:49.730772+0000","last_clean":"2024-03-23T23:58:49.730772+0000","last_became_active":"2024-03-23T23:56:30.887272+0000","last_became_peered":"2024-03-23T23:56:30.887272+0000","last_unstale":"2024-03-23T23:58:49.730772+0000","last_undegraded":"2024-03-23T23:58:49.730772+0000","last_fullsized":"2024-03-23T23:58:49.730772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'27","last_scrub_stamp":"2024-03-23T23:58:49.730476+0000","last_deep_scrub":"24'27","last_deep_scrub_stamp":"2024-03-23T23:58:49.730476+0000","last_clean_scrub_stamp":"2024-03-23T23:58:49.730476+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:25:53.783798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.409945+0000","last_change":"2024-03-23T23:58:35.409945+0000","last_active":"2024-03-23T23:58:35.409945+0000","last_peered":"2024-03-23T23:58:35.409945+0000","last_clean":"2024-03-23T23:58:35.409945+0000","last_became_active":"2024-03-23T23:56:29.896527+0000","last_became_peered":"2024-03-23T23:56:29.896527+0000","last_unstale":"2024-03-23T23:58:35.409945+0000","last_undegraded":"2024-03-23T23:58:35.409945+0000","last_fullsized":"2024-03-23T23:58:35.409945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:35.409423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:35.409423+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.409423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:50.168686+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.457142+0000","last_change":"2024-03-23T23:58:37.457142+0000","last_active":"2024-03-23T23:58:37.457142+0000","last_peered":"2024-03-23T23:58:37.457142+0000","last_clean":"2024-03-23T23:58:37.457142+0000","last_became_active":"2024-03-23T23:56:30.875851+0000","last_became_peered":"2024-03-23T23:56:30.875851+0000","last_unstale":"2024-03-23T23:58:37.457142+0000","last_undegraded":"2024-03-23T23:58:37.457142+0000","last_fullsized":"2024-03-23T23:58:37.457142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:37.456665+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:37.456665+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.456665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:07:01.789974+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"24'12","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:28.729419+0000","last_change":"2024-03-23T23:58:28.729419+0000","last_active":"2024-03-23T23:58:28.729419+0000","last_peered":"2024-03-23T23:58:28.729419+0000","last_clean":"2024-03-23T23:58:28.729419+0000","last_became_active":"2024-03-23T23:56:29.879124+0000","last_became_peered":"2024-03-23T23:56:29.879124+0000","last_unstale":"2024-03-23T23:58:28.729419+0000","last_undegraded":"2024-03-23T23:58:28.729419+0000","last_fullsized":"2024-03-23T23:58:28.729419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-03-23T23:58:28.729300+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-03-23T23:58:28.729300+0000","last_clean_scrub_stamp":"2024-03-23T23:58:28.729300+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:45:05.884546+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"24'14","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:47.701340+0000","last_change":"2024-03-23T23:58:47.701340+0000","last_active":"2024-03-23T23:58:47.701340+0000","last_peered":"2024-03-23T23:58:47.701340+0000","last_clean":"2024-03-23T23:58:47.701340+0000","last_became_active":"2024-03-23T23:56:30.888010+0000","last_became_peered":"2024-03-23T23:56:30.888010+0000","last_unstale":"2024-03-23T23:58:47.701340+0000","last_undegraded":"2024-03-23T23:58:47.701340+0000","last_fullsized":"2024-03-23T23:58:47.701340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:47.701090+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:47.701090+0000","last_clean_scrub_stamp":"2024-03-23T23:58:47.701090+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:44:07.945038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.956804+0000","last_change":"2024-03-23T23:58:29.956804+0000","last_active":"2024-03-23T23:58:29.956804+0000","last_peered":"2024-03-23T23:58:29.956804+0000","last_clean":"2024-03-23T23:58:29.956804+0000","last_became_active":"2024-03-23T23:56:29.892215+0000","last_became_peered":"2024-03-23T23:56:29.892215+0000","last_unstale":"2024-03-23T23:58:29.956804+0000","last_undegraded":"2024-03-23T23:58:29.956804+0000","last_fullsized":"2024-03-23T23:58:29.956804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-03-23T23:58:29.956348+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-03-23T23:58:29.956348+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.956348+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:46:38.420794+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"24'12","reported_seq":40,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:48.686929+0000","last_change":"2024-03-23T23:58:48.686991+0000","last_active":"2024-03-23T23:58:48.686929+0000","last_peered":"2024-03-23T23:58:48.686929+0000","last_clean":"2024-03-23T23:58:48.686929+0000","last_became_active":"2024-03-23T23:56:30.889940+0000","last_became_peered":"2024-03-23T23:56:30.889940+0000","last_unstale":"2024-03-23T23:58:48.686929+0000","last_undegraded":"2024-03-23T23:58:48.686929+0000","last_fullsized":"2024-03-23T23:58:48.686929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12","last_scrub_stamp":"2024-03-23T23:58:48.686698+0000","last_deep_scrub":"24'12","last_deep_scrub_stamp":"2024-03-23T23:58:48.686698+0000","last_clean_scrub_stamp":"2024-03-23T23:58:48.686698+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:02:40.259832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.721054+0000","last_change":"2024-03-23T23:58:29.721054+0000","last_active":"2024-03-23T23:58:29.721054+0000","last_peered":"2024-03-23T23:58:29.721054+0000","last_clean":"2024-03-23T23:58:29.721054+0000","last_became_active":"2024-03-23T23:56:29.883152+0000","last_became_peered":"2024-03-23T23:56:29.883152+0000","last_unstale":"2024-03-23T23:58:29.721054+0000","last_undegraded":"2024-03-23T23:58:29.721054+0000","last_fullsized":"2024-03-23T23:58:29.721054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-03-23T23:58:29.720871+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-03-23T23:58:29.720871+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.720871+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:37:29.018890+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"24'17","reported_seq":45,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:46.731310+0000","last_change":"2024-03-23T23:58:46.731310+0000","last_active":"2024-03-23T23:58:46.731310+0000","last_peered":"2024-03-23T23:58:46.731310+0000","last_clean":"2024-03-23T23:58:46.731310+0000","last_became_active":"2024-03-23T23:56:30.887229+0000","last_became_peered":"2024-03-23T23:56:30.887229+0000","last_unstale":"2024-03-23T23:58:46.731310+0000","last_undegraded":"2024-03-23T23:58:46.731310+0000","last_fullsized":"2024-03-23T23:58:46.731310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'17","last_scrub_stamp":"2024-03-23T23:58:46.730894+0000","last_deep_scrub":"24'17","last_deep_scrub_stamp":"2024-03-23T23:58:46.730894+0000","last_clean_scrub_stamp":"2024-03-23T23:58:46.730894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:41:12.138973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'2","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.951810+0000","last_change":"2024-03-23T23:58:32.951810+0000","last_active":"2024-03-23T23:58:32.951810+0000","last_peered":"2024-03-23T23:58:32.951810+0000","last_clean":"2024-03-23T23:58:32.951810+0000","last_became_active":"2024-03-23T23:56:29.897622+0000","last_became_peered":"2024-03-23T23:56:29.897622+0000","last_unstale":"2024-03-23T23:58:32.951810+0000","last_undegraded":"2024-03-23T23:58:32.951810+0000","last_fullsized":"2024-03-23T23:58:32.951810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'2","last_scrub_stamp":"2024-03-23T23:58:32.951544+0000","last_deep_scrub":"24'2","last_deep_scrub_stamp":"2024-03-23T23:58:32.951544+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.951544+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:13:47.710807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.232464+0000","last_change":"2024-03-23T23:58:39.232464+0000","last_active":"2024-03-23T23:58:39.232464+0000","last_peered":"2024-03-23T23:58:39.232464+0000","last_clean":"2024-03-23T23:58:39.232464+0000","last_became_active":"2024-03-23T23:56:30.887340+0000","last_became_peered":"2024-03-23T23:56:30.887340+0000","last_unstale":"2024-03-23T23:58:39.232464+0000","last_undegraded":"2024-03-23T23:58:39.232464+0000","last_fullsized":"2024-03-23T23:58:39.232464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:39.232061+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:39.232061+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.232061+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:31:02.836677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.727689+0000","last_change":"2024-03-23T23:58:31.727689+0000","last_active":"2024-03-23T23:58:31.727689+0000","last_peered":"2024-03-23T23:58:31.727689+0000","last_clean":"2024-03-23T23:58:31.727689+0000","last_became_active":"2024-03-23T23:56:29.888173+0000","last_became_peered":"2024-03-23T23:56:29.888173+0000","last_unstale":"2024-03-23T23:58:31.727689+0000","last_undegraded":"2024-03-23T23:58:31.727689+0000","last_fullsized":"2024-03-23T23:58:31.727689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:31.727579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:31.727579+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.727579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:25.235687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'15","reported_seq":43,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.706357+0000","last_change":"2024-03-23T23:58:32.706357+0000","last_active":"2024-03-23T23:58:32.706357+0000","last_peered":"2024-03-23T23:58:32.706357+0000","last_clean":"2024-03-23T23:58:32.706357+0000","last_became_active":"2024-03-23T23:56:30.883264+0000","last_became_peered":"2024-03-23T23:56:30.883264+0000","last_unstale":"2024-03-23T23:58:32.706357+0000","last_undegraded":"2024-03-23T23:58:32.706357+0000","last_fullsized":"2024-03-23T23:58:32.706357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:32.706078+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:32.706078+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.706078+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:31:35.155657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":188,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.691902+0000","last_change":"2024-03-23T23:58:34.692054+0000","last_active":"2024-03-23T23:58:34.691902+0000","last_peered":"2024-03-23T23:58:34.691902+0000","last_clean":"2024-03-23T23:58:34.691902+0000","last_became_active":"2024-03-23T23:56:21.615011+0000","last_became_peered":"2024-03-23T23:56:21.615011+0000","last_unstale":"2024-03-23T23:58:34.691902+0000","last_undegraded":"2024-03-23T23:58:34.691902+0000","last_fullsized":"2024-03-23T23:58:34.691902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2024-03-23T23:58:34.691532+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2024-03-23T23:58:34.691532+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.691532+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:28:34.357918+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.314117+0000","last_change":"2024-03-23T23:58:31.314117+0000","last_active":"2024-03-23T23:58:31.314117+0000","last_peered":"2024-03-23T23:58:31.314117+0000","last_clean":"2024-03-23T23:58:31.314117+0000","last_became_active":"2024-03-23T23:56:29.885673+0000","last_became_peered":"2024-03-23T23:56:29.885673+0000","last_unstale":"2024-03-23T23:58:31.314117+0000","last_undegraded":"2024-03-23T23:58:31.314117+0000","last_fullsized":"2024-03-23T23:58:31.314117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:31.313889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:31.313889+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.313889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:37:12.419609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.568794+0000","last_change":"2024-03-23T23:58:36.568794+0000","last_active":"2024-03-23T23:58:36.568794+0000","last_peered":"2024-03-23T23:58:36.568794+0000","last_clean":"2024-03-23T23:58:36.568794+0000","last_became_active":"2024-03-23T23:56:30.882512+0000","last_became_peered":"2024-03-23T23:56:30.882512+0000","last_unstale":"2024-03-23T23:58:36.568794+0000","last_undegraded":"2024-03-23T23:58:36.568794+0000","last_fullsized":"2024-03-23T23:58:36.568794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:36.568383+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:36.568383+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.568383+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:32.219758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.681258+0000","last_change":"2024-03-23T23:58:36.681311+0000","last_active":"2024-03-23T23:58:36.681258+0000","last_peered":"2024-03-23T23:58:36.681258+0000","last_clean":"2024-03-23T23:58:36.681258+0000","last_became_active":"2024-03-23T23:56:29.881312+0000","last_became_peered":"2024-03-23T23:56:29.881312+0000","last_unstale":"2024-03-23T23:58:36.681258+0000","last_undegraded":"2024-03-23T23:58:36.681258+0000","last_fullsized":"2024-03-23T23:58:36.681258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:36.680989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:36.680989+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.680989+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:55:32.332365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'10","reported_seq":38,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:36.876227+0000","last_change":"2024-03-23T23:58:36.876227+0000","last_active":"2024-03-23T23:58:36.876227+0000","last_peered":"2024-03-23T23:58:36.876227+0000","last_clean":"2024-03-23T23:58:36.876227+0000","last_became_active":"2024-03-23T23:56:30.884755+0000","last_became_peered":"2024-03-23T23:56:30.884755+0000","last_unstale":"2024-03-23T23:58:36.876227+0000","last_undegraded":"2024-03-23T23:58:36.876227+0000","last_fullsized":"2024-03-23T23:58:36.876227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:36.875719+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:36.875719+0000","last_clean_scrub_stamp":"2024-03-23T23:58:36.875719+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:32.321679+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"24'10","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.690454+0000","last_change":"2024-03-23T23:58:30.690454+0000","last_active":"2024-03-23T23:58:30.690454+0000","last_peered":"2024-03-23T23:58:30.690454+0000","last_clean":"2024-03-23T23:58:30.690454+0000","last_became_active":"2024-03-23T23:56:29.885974+0000","last_became_peered":"2024-03-23T23:56:29.885974+0000","last_unstale":"2024-03-23T23:58:30.690454+0000","last_undegraded":"2024-03-23T23:58:30.690454+0000","last_fullsized":"2024-03-23T23:58:30.690454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10","last_scrub_stamp":"2024-03-23T23:58:30.690291+0000","last_deep_scrub":"24'10","last_deep_scrub_stamp":"2024-03-23T23:58:30.690291+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.690291+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:46:02.766236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1111,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":9,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'21","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.936967+0000","last_change":"2024-03-23T23:58:34.937076+0000","last_active":"2024-03-23T23:58:34.936967+0000","last_peered":"2024-03-23T23:58:34.936967+0000","last_clean":"2024-03-23T23:58:34.936967+0000","last_became_active":"2024-03-23T23:56:30.873365+0000","last_became_peered":"2024-03-23T23:56:30.873365+0000","last_unstale":"2024-03-23T23:58:34.936967+0000","last_undegraded":"2024-03-23T23:58:34.936967+0000","last_fullsized":"2024-03-23T23:58:34.936967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'21","last_scrub_stamp":"2024-03-23T23:58:34.936786+0000","last_deep_scrub":"24'21","last_deep_scrub_stamp":"2024-03-23T23:58:34.936786+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.936786+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:06:59.270095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:33.285440+0000","last_change":"2024-03-23T23:58:33.285440+0000","last_active":"2024-03-23T23:58:33.285440+0000","last_peered":"2024-03-23T23:58:33.285440+0000","last_clean":"2024-03-23T23:58:33.285440+0000","last_became_active":"2024-03-23T23:56:29.888302+0000","last_became_peered":"2024-03-23T23:56:29.888302+0000","last_unstale":"2024-03-23T23:58:33.285440+0000","last_undegraded":"2024-03-23T23:58:33.285440+0000","last_fullsized":"2024-03-23T23:58:33.285440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-03-23T23:58:33.285119+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-03-23T23:58:33.285119+0000","last_clean_scrub_stamp":"2024-03-23T23:58:33.285119+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:06:02.139794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'11","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.089513+0000","last_change":"2024-03-23T23:58:35.089513+0000","last_active":"2024-03-23T23:58:35.089513+0000","last_peered":"2024-03-23T23:58:35.089513+0000","last_clean":"2024-03-23T23:58:35.089513+0000","last_became_active":"2024-03-23T23:56:30.882691+0000","last_became_peered":"2024-03-23T23:56:30.882691+0000","last_unstale":"2024-03-23T23:58:35.089513+0000","last_undegraded":"2024-03-23T23:58:35.089513+0000","last_fullsized":"2024-03-23T23:58:35.089513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:35.089262+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:35.089262+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.089262+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:16:23.986288+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:27.894134+0000","last_change":"2024-03-23T23:58:27.894134+0000","last_active":"2024-03-23T23:58:27.894134+0000","last_peered":"2024-03-23T23:58:27.894134+0000","last_clean":"2024-03-23T23:58:27.894134+0000","last_became_active":"2024-03-23T23:56:29.883321+0000","last_became_peered":"2024-03-23T23:56:29.883321+0000","last_unstale":"2024-03-23T23:58:27.894134+0000","last_undegraded":"2024-03-23T23:58:27.894134+0000","last_fullsized":"2024-03-23T23:58:27.894134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:27.893788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:27.893788+0000","last_clean_scrub_stamp":"2024-03-23T23:58:27.893788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:21.401896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'13","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.225471+0000","last_change":"2024-03-23T23:58:41.225531+0000","last_active":"2024-03-23T23:58:41.225471+0000","last_peered":"2024-03-23T23:58:41.225471+0000","last_clean":"2024-03-23T23:58:41.225471+0000","last_became_active":"2024-03-23T23:56:30.886610+0000","last_became_peered":"2024-03-23T23:56:30.886610+0000","last_unstale":"2024-03-23T23:58:41.225471+0000","last_undegraded":"2024-03-23T23:58:41.225471+0000","last_fullsized":"2024-03-23T23:58:41.225471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-03-23T23:58:41.225290+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-03-23T23:58:41.225290+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.225290+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:25:53.131562+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.743748+0000","last_change":"2024-03-23T23:58:38.743848+0000","last_active":"2024-03-23T23:58:38.743748+0000","last_peered":"2024-03-23T23:58:38.743748+0000","last_clean":"2024-03-23T23:58:38.743748+0000","last_became_active":"2024-03-23T23:56:29.884559+0000","last_became_peered":"2024-03-23T23:56:29.884559+0000","last_unstale":"2024-03-23T23:58:38.743748+0000","last_undegraded":"2024-03-23T23:58:38.743748+0000","last_fullsized":"2024-03-23T23:58:38.743748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:38.743469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:38.743469+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.743469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:56.368028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'16","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.989293+0000","last_change":"2024-03-23T23:58:37.989293+0000","last_active":"2024-03-23T23:58:37.989293+0000","last_peered":"2024-03-23T23:58:37.989293+0000","last_clean":"2024-03-23T23:58:37.989293+0000","last_became_active":"2024-03-23T23:56:30.877861+0000","last_became_peered":"2024-03-23T23:56:30.877861+0000","last_unstale":"2024-03-23T23:58:37.989293+0000","last_undegraded":"2024-03-23T23:58:37.989293+0000","last_fullsized":"2024-03-23T23:58:37.989293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:37.989044+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:37.989044+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.989044+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:40:33.435004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:29.957918+0000","last_change":"2024-03-23T23:58:29.957918+0000","last_active":"2024-03-23T23:58:29.957918+0000","last_peered":"2024-03-23T23:58:29.957918+0000","last_clean":"2024-03-23T23:58:29.957918+0000","last_became_active":"2024-03-23T23:56:29.884472+0000","last_became_peered":"2024-03-23T23:56:29.884472+0000","last_unstale":"2024-03-23T23:58:29.957918+0000","last_undegraded":"2024-03-23T23:58:29.957918+0000","last_fullsized":"2024-03-23T23:58:29.957918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-03-23T23:58:29.957813+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-03-23T23:58:29.957813+0000","last_clean_scrub_stamp":"2024-03-23T23:58:29.957813+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:28:08.694684+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"24'15","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.662682+0000","last_change":"2024-03-23T23:58:35.662743+0000","last_active":"2024-03-23T23:58:35.662682+0000","last_peered":"2024-03-23T23:58:35.662682+0000","last_clean":"2024-03-23T23:58:35.662682+0000","last_became_active":"2024-03-23T23:57:11.227669+0000","last_became_peered":"2024-03-23T23:57:11.227669+0000","last_unstale":"2024-03-23T23:58:35.662682+0000","last_undegraded":"2024-03-23T23:58:35.662682+0000","last_fullsized":"2024-03-23T23:58:35.662682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'15","last_scrub_stamp":"2024-03-23T23:58:35.662480+0000","last_deep_scrub":"24'15","last_deep_scrub_stamp":"2024-03-23T23:58:35.662480+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.662480+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:17:33.315116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.489042+0000","last_change":"2024-03-23T23:58:31.489042+0000","last_active":"2024-03-23T23:58:31.489042+0000","last_peered":"2024-03-23T23:58:31.489042+0000","last_clean":"2024-03-23T23:58:31.489042+0000","last_became_active":"2024-03-23T23:56:29.880907+0000","last_became_peered":"2024-03-23T23:56:29.880907+0000","last_unstale":"2024-03-23T23:58:31.489042+0000","last_undegraded":"2024-03-23T23:58:31.489042+0000","last_fullsized":"2024-03-23T23:58:31.489042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-03-23T23:58:31.488632+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-03-23T23:58:31.488632+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.488632+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:30:21.794055+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'19","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:28.889134+0000","last_change":"2024-03-23T23:58:28.889134+0000","last_active":"2024-03-23T23:58:28.889134+0000","last_peered":"2024-03-23T23:58:28.889134+0000","last_clean":"2024-03-23T23:58:28.889134+0000","last_became_active":"2024-03-23T23:56:30.874154+0000","last_became_peered":"2024-03-23T23:56:30.874154+0000","last_unstale":"2024-03-23T23:58:28.889134+0000","last_undegraded":"2024-03-23T23:58:28.889134+0000","last_fullsized":"2024-03-23T23:58:28.889134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'19","last_scrub_stamp":"2024-03-23T23:58:28.888851+0000","last_deep_scrub":"24'19","last_deep_scrub_stamp":"2024-03-23T23:58:28.888851+0000","last_clean_scrub_stamp":"2024-03-23T23:58:28.888851+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:31:04.548921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.704131+0000","last_change":"2024-03-23T23:58:37.704131+0000","last_active":"2024-03-23T23:58:37.704131+0000","last_peered":"2024-03-23T23:58:37.704131+0000","last_clean":"2024-03-23T23:58:37.704131+0000","last_became_active":"2024-03-23T23:56:29.879525+0000","last_became_peered":"2024-03-23T23:56:29.879525+0000","last_unstale":"2024-03-23T23:58:37.704131+0000","last_undegraded":"2024-03-23T23:58:37.704131+0000","last_fullsized":"2024-03-23T23:58:37.704131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:37.703865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:37.703865+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.703865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:22.106053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"24'7","reported_seq":35,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.056694+0000","last_change":"2024-03-23T23:58:34.056694+0000","last_active":"2024-03-23T23:58:34.056694+0000","last_peered":"2024-03-23T23:58:34.056694+0000","last_clean":"2024-03-23T23:58:34.056694+0000","last_became_active":"2024-03-23T23:56:30.874321+0000","last_became_peered":"2024-03-23T23:56:30.874321+0000","last_unstale":"2024-03-23T23:58:34.056694+0000","last_undegraded":"2024-03-23T23:58:34.056694+0000","last_fullsized":"2024-03-23T23:58:34.056694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7","last_scrub_stamp":"2024-03-23T23:58:34.056436+0000","last_deep_scrub":"24'7","last_deep_scrub_stamp":"2024-03-23T23:58:34.056436+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.056436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T07:59:23.012665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:31.942115+0000","last_change":"2024-03-23T23:58:31.942115+0000","last_active":"2024-03-23T23:58:31.942115+0000","last_peered":"2024-03-23T23:58:31.942115+0000","last_clean":"2024-03-23T23:58:31.942115+0000","last_became_active":"2024-03-23T23:56:29.887565+0000","last_became_peered":"2024-03-23T23:56:29.887565+0000","last_unstale":"2024-03-23T23:58:31.942115+0000","last_undegraded":"2024-03-23T23:58:31.942115+0000","last_fullsized":"2024-03-23T23:58:31.942115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:31.941973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:31.941973+0000","last_clean_scrub_stamp":"2024-03-23T23:58:31.941973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:17:29.594609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"24'16","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:32.660933+0000","last_change":"2024-03-23T23:58:32.660933+0000","last_active":"2024-03-23T23:58:32.660933+0000","last_peered":"2024-03-23T23:58:32.660933+0000","last_clean":"2024-03-23T23:58:32.660933+0000","last_became_active":"2024-03-23T23:56:30.875610+0000","last_became_peered":"2024-03-23T23:56:30.875610+0000","last_unstale":"2024-03-23T23:58:32.660933+0000","last_undegraded":"2024-03-23T23:58:32.660933+0000","last_fullsized":"2024-03-23T23:58:32.660933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:32.660672+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:32.660672+0000","last_clean_scrub_stamp":"2024-03-23T23:58:32.660672+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T05:01:25.430105+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:28.927305+0000","last_change":"2024-03-23T23:58:28.927305+0000","last_active":"2024-03-23T23:58:28.927305+0000","last_peered":"2024-03-23T23:58:28.927305+0000","last_clean":"2024-03-23T23:58:28.927305+0000","last_became_active":"2024-03-23T23:56:29.884371+0000","last_became_peered":"2024-03-23T23:56:29.884371+0000","last_unstale":"2024-03-23T23:58:28.927305+0000","last_undegraded":"2024-03-23T23:58:28.927305+0000","last_fullsized":"2024-03-23T23:58:28.927305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T23:58:28.927166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T23:58:28.927166+0000","last_clean_scrub_stamp":"2024-03-23T23:58:28.927166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:50:38.495463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"24'18","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:38.640656+0000","last_change":"2024-03-23T23:58:38.640656+0000","last_active":"2024-03-23T23:58:38.640656+0000","last_peered":"2024-03-23T23:58:38.640656+0000","last_clean":"2024-03-23T23:58:38.640656+0000","last_became_active":"2024-03-23T23:56:30.886868+0000","last_became_peered":"2024-03-23T23:56:30.886868+0000","last_unstale":"2024-03-23T23:58:38.640656+0000","last_undegraded":"2024-03-23T23:58:38.640656+0000","last_fullsized":"2024-03-23T23:58:38.640656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18","last_scrub_stamp":"2024-03-23T23:58:38.640394+0000","last_deep_scrub":"24'18","last_deep_scrub_stamp":"2024-03-23T23:58:38.640394+0000","last_clean_scrub_stamp":"2024-03-23T23:58:38.640394+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:08:56.264953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.782751+0000","last_change":"2024-03-23T23:58:40.782751+0000","last_active":"2024-03-23T23:58:40.782751+0000","last_peered":"2024-03-23T23:58:40.782751+0000","last_clean":"2024-03-23T23:58:40.782751+0000","last_became_active":"2024-03-23T23:56:29.895180+0000","last_became_peered":"2024-03-23T23:56:29.895180+0000","last_unstale":"2024-03-23T23:58:40.782751+0000","last_undegraded":"2024-03-23T23:58:40.782751+0000","last_fullsized":"2024-03-23T23:58:40.782751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-03-23T23:58:40.782483+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-03-23T23:58:40.782483+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.782483+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T06:31:04.387100+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"24'14","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:41.385529+0000","last_change":"2024-03-23T23:58:41.385529+0000","last_active":"2024-03-23T23:58:41.385529+0000","last_peered":"2024-03-23T23:58:41.385529+0000","last_clean":"2024-03-23T23:58:41.385529+0000","last_became_active":"2024-03-23T23:56:30.883582+0000","last_became_peered":"2024-03-23T23:56:30.883582+0000","last_unstale":"2024-03-23T23:58:41.385529+0000","last_undegraded":"2024-03-23T23:58:41.385529+0000","last_fullsized":"2024-03-23T23:58:41.385529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14","last_scrub_stamp":"2024-03-23T23:58:41.385244+0000","last_deep_scrub":"24'14","last_deep_scrub_stamp":"2024-03-23T23:58:41.385244+0000","last_clean_scrub_stamp":"2024-03-23T23:58:41.385244+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:21:26.933877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"24'23","reported_seq":51,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:42.274856+0000","last_change":"2024-03-23T23:58:42.274856+0000","last_active":"2024-03-23T23:58:42.274856+0000","last_peered":"2024-03-23T23:58:42.274856+0000","last_clean":"2024-03-23T23:58:42.274856+0000","last_became_active":"2024-03-23T23:56:30.888824+0000","last_became_peered":"2024-03-23T23:56:30.888824+0000","last_unstale":"2024-03-23T23:58:42.274856+0000","last_undegraded":"2024-03-23T23:58:42.274856+0000","last_fullsized":"2024-03-23T23:58:42.274856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'23","last_scrub_stamp":"2024-03-23T23:58:42.274543+0000","last_deep_scrub":"24'23","last_deep_scrub_stamp":"2024-03-23T23:58:42.274543+0000","last_clean_scrub_stamp":"2024-03-23T23:58:42.274543+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T00:23:17.083362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"24'3","reported_seq":33,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:39.745034+0000","last_change":"2024-03-23T23:58:39.745034+0000","last_active":"2024-03-23T23:58:39.745034+0000","last_peered":"2024-03-23T23:58:39.745034+0000","last_clean":"2024-03-23T23:58:39.745034+0000","last_became_active":"2024-03-23T23:56:29.888386+0000","last_became_peered":"2024-03-23T23:56:29.888386+0000","last_unstale":"2024-03-23T23:58:39.745034+0000","last_undegraded":"2024-03-23T23:58:39.745034+0000","last_fullsized":"2024-03-23T23:58:39.745034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2024-03-23T23:58:39.744663+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2024-03-23T23:58:39.744663+0000","last_clean_scrub_stamp":"2024-03-23T23:58:39.744663+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T02:04:18.976998+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'13","reported_seq":41,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:40.257753+0000","last_change":"2024-03-23T23:58:40.257753+0000","last_active":"2024-03-23T23:58:40.257753+0000","last_peered":"2024-03-23T23:58:40.257753+0000","last_clean":"2024-03-23T23:58:40.257753+0000","last_became_active":"2024-03-23T23:56:30.887726+0000","last_became_peered":"2024-03-23T23:56:30.887726+0000","last_unstale":"2024-03-23T23:58:40.257753+0000","last_undegraded":"2024-03-23T23:58:40.257753+0000","last_fullsized":"2024-03-23T23:58:40.257753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13","last_scrub_stamp":"2024-03-23T23:58:40.257297+0000","last_deep_scrub":"24'13","last_deep_scrub_stamp":"2024-03-23T23:58:40.257297+0000","last_clean_scrub_stamp":"2024-03-23T23:58:40.257297+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:00:42.598785+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"24'4","reported_seq":34,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:35.701509+0000","last_change":"2024-03-23T23:58:35.701509+0000","last_active":"2024-03-23T23:58:35.701509+0000","last_peered":"2024-03-23T23:58:35.701509+0000","last_clean":"2024-03-23T23:58:35.701509+0000","last_became_active":"2024-03-23T23:56:29.879557+0000","last_became_peered":"2024-03-23T23:56:29.879557+0000","last_unstale":"2024-03-23T23:58:35.701509+0000","last_undegraded":"2024-03-23T23:58:35.701509+0000","last_fullsized":"2024-03-23T23:58:35.701509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2024-03-23T23:58:35.701083+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2024-03-23T23:58:35.701083+0000","last_clean_scrub_stamp":"2024-03-23T23:58:35.701083+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T08:35:45.491672+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'16","reported_seq":49,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:37.854192+0000","last_change":"2024-03-23T23:58:37.854192+0000","last_active":"2024-03-23T23:58:37.854192+0000","last_peered":"2024-03-23T23:58:37.854192+0000","last_clean":"2024-03-23T23:58:37.854192+0000","last_became_active":"2024-03-23T23:57:11.437365+0000","last_became_peered":"2024-03-23T23:57:11.437365+0000","last_unstale":"2024-03-23T23:58:37.854192+0000","last_undegraded":"2024-03-23T23:58:37.854192+0000","last_fullsized":"2024-03-23T23:58:37.854192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'16","last_scrub_stamp":"2024-03-23T23:58:37.853904+0000","last_deep_scrub":"24'16","last_deep_scrub_stamp":"2024-03-23T23:58:37.853904+0000","last_clean_scrub_stamp":"2024-03-23T23:58:37.853904+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:41:22.256092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:30.618510+0000","last_change":"2024-03-23T23:58:30.618510+0000","last_active":"2024-03-23T23:58:30.618510+0000","last_peered":"2024-03-23T23:58:30.618510+0000","last_clean":"2024-03-23T23:58:30.618510+0000","last_became_active":"2024-03-23T23:56:29.889099+0000","last_became_peered":"2024-03-23T23:56:29.889099+0000","last_unstale":"2024-03-23T23:58:30.618510+0000","last_undegraded":"2024-03-23T23:58:30.618510+0000","last_fullsized":"2024-03-23T23:58:30.618510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-03-23T23:58:30.618235+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-03-23T23:58:30.618235+0000","last_clean_scrub_stamp":"2024-03-23T23:58:30.618235+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T03:17:28.270871+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"24'11","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:34.622778+0000","last_change":"2024-03-23T23:58:34.622906+0000","last_active":"2024-03-23T23:58:34.622778+0000","last_peered":"2024-03-23T23:58:34.622778+0000","last_clean":"2024-03-23T23:58:34.622778+0000","last_became_active":"2024-03-23T23:57:11.077960+0000","last_became_peered":"2024-03-23T23:57:11.077960+0000","last_unstale":"2024-03-23T23:58:34.622778+0000","last_undegraded":"2024-03-23T23:58:34.622778+0000","last_fullsized":"2024-03-23T23:58:34.622778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11","last_scrub_stamp":"2024-03-23T23:58:34.622546+0000","last_deep_scrub":"24'11","last_deep_scrub_stamp":"2024-03-23T23:58:34.622546+0000","last_clean_scrub_stamp":"2024-03-23T23:58:34.622546+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T09:19:44.007147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"24'6","reported_seq":36,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T23:58:26.902590+0000","last_change":"2024-03-23T23:58:26.902590+0000","last_active":"2024-03-23T23:58:26.902590+0000","last_peered":"2024-03-23T23:58:26.902590+0000","last_clean":"2024-03-23T23:58:26.902590+0000","last_became_active":"2024-03-23T23:56:29.885958+0000","last_became_peered":"2024-03-23T23:56:29.885958+0000","last_unstale":"2024-03-23T23:58:26.902590+0000","last_undegraded":"2024-03-23T23:58:26.902590+0000","last_fullsized":"2024-03-23T23:58:26.902590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2024-03-23T23:58:26.902292+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2024-03-23T23:58:26.902292+0000","last_clean_scrub_stamp":"2024-03-23T23:58:26.902292+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T01:10:20.410400+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":21,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":42,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1028,"ondisk_log_size":1028,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":148561,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":182,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":297122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":864256,"data_stored":684857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":240550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":93994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":94027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":241670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":95015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":94061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":868352,"data_stored":684910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":147763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":146652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":6,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":9,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T23:59:13.452 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-23T23:59:13.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.708+0000 7f0e5ec00640 1 Processor -- start 2024-03-23T23:59:13.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.708+0000 7f0e5ec00640 1 -- start start 2024-03-23T23:59:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.709+0000 7f0e5ec00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b3040 0x7f0e580addb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.709+0000 7f0e5ec00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e580ad660 0x7f0e58140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.709+0000 7f0e5ec00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580af270 con 0x7f0e580b57d0 2024-03-23T23:59:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.709+0000 7f0e5ec00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580b5bb0 con 0x7f0e580ad660 2024-03-23T23:59:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.709+0000 7f0e5ec00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5814a7e0 con 0x7f0e580b3040 2024-03-23T23:59:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.709+0000 7f0e5e200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0e580ad660 0x7f0e58140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.709+0000 7f0e5d800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0e580b57d0 0x7f0e5814afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34674/0 (socket says 172.21.15.31:34674) 2024-03-23T23:59:13.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.710+0000 7f0e5d800640 1 -- 172.21.15.31:0/1317003971 learned_addr learned my addr 172.21.15.31:0/1317003971 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:59:13.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.710+0000 7f0e5ce00640 1 --2- 172.21.15.31:0/1317003971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b3040 0x7f0e580addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.710+0000 7f0e5e200640 1 -- 172.21.15.31:0/1317003971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b3040 msgr2=0x7f0e580addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:13.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.710+0000 7f0e5e200640 1 --2- 172.21.15.31:0/1317003971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b3040 0x7f0e580addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.710+0000 7f0e5e200640 1 -- 172.21.15.31:0/1317003971 >> v1:172.21.15.31:6789/0 conn(0x7f0e580b57d0 legacy=0x7f0e5814afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.710+0000 7f0e57e00640 1 -- 172.21.15.31:0/1317003971 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497528977 0 0) 0x7f0e580af270 con 0x7f0e580b57d0 2024-03-23T23:59:13.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.710+0000 7f0e5e200640 1 -- 172.21.15.31:0/1317003971 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5814aac0 con 0x7f0e580ad660 2024-03-23T23:59:13.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.711+0000 7f0e5e200640 1 --2- 172.21.15.31:0/1317003971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e58140fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f6956d5dc0aee8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:13.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.711+0000 7f0e57e00640 1 -- 172.21.15.31:0/1317003971 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50039070 con 0x7f0e580ad660 2024-03-23T23:59:13.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.711+0000 7f0e57e00640 1 -- 172.21.15.31:0/1317003971 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5002cbc0 con 0x7f0e580ad660 2024-03-23T23:59:13.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.711+0000 7f0e57e00640 1 -- 172.21.15.31:0/1317003971 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50034440 con 0x7f0e580ad660 2024-03-23T23:59:13.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 -- 172.21.15.31:0/1317003971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 msgr2=0x7f0e58140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/1317003971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e58140fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009d90 tx=0x7f0e5002be10 comp rx=0 tx=0).stop 2024-03-23T23:59:13.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 -- 172.21.15.31:0/1317003971 shutdown_connections 2024-03-23T23:59:13.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/1317003971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e58140fe0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/1317003971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b3040 0x7f0e580addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 -- 172.21.15.31:0/1317003971 >> 172.21.15.31:0/1317003971 conn(0x7f0e5806be60 msgr2=0x7f0e5806c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:13.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 -- 172.21.15.31:0/1317003971 shutdown_connections 2024-03-23T23:59:13.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.712+0000 7f0e5ec00640 1 -- 172.21.15.31:0/1317003971 wait complete. 2024-03-23T23:59:13.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.714+0000 7f0e5ec00640 1 Processor -- start 2024-03-23T23:59:13.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.714+0000 7f0e5ec00640 1 -- start start 2024-03-23T23:59:13.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.714+0000 7f0e5ec00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e5813b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.714+0000 7f0e5ec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580b3040 0x7f0e5813c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.714+0000 7f0e5ec00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b57d0 0x7f0e58143c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5ec00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58141730 con 0x7f0e580ad660 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5ec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581519d0 con 0x7f0e580b3040 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5ec00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5813a7c0 con 0x7f0e580b57d0 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e5813b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e5813b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58204/0 (socket says 172.21.15.31:58204) 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 -- 172.21.15.31:0/2756381113 learned_addr learned my addr 172.21.15.31:0/2756381113 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:13.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5e200640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b57d0 0x7f0e58143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 -- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b57d0 msgr2=0x7f0e58143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b57d0 0x7f0e58143c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 -- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580b3040 msgr2=0x7f0e5813c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580b3040 0x7f0e5813c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.715+0000 7f0e5d800640 1 -- 172.21.15.31:0/2756381113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5813ceb0 con 0x7f0e580ad660 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.716+0000 7f0e5d800640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e5813b640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c430 tx=0x7f0e4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.716+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0074e0 con 0x7f0e580ad660 2024-03-23T23:59:13.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.716+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0047e0 con 0x7f0e580ad660 2024-03-23T23:59:13.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.716+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c004bd0 con 0x7f0e580ad660 2024-03-23T23:59:13.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.716+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5813bd20 con 0x7f0e580ad660 2024-03-23T23:59:13.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.716+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580b2890 con 0x7f0e580ad660 2024-03-23T23:59:13.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.717+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5813ccd0 con 0x7f0e580ad660 2024-03-23T23:59:13.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.718+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0e4c011070 con 0x7f0e580ad660 2024-03-23T23:59:13.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.719+0000 7f0e55600640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0e3806bbd0 0x7f0e3806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:13.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.719+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f0e4c08a700 con 0x7f0e580ad660 2024-03-23T23:59:13.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.719+0000 7f0e5ce00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0e3806bbd0 0x7f0e3806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:13.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.721+0000 7f0e5ce00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0e3806bbd0 0x7f0e3806e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e5809d7e0 tx=0x7f0e44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:13.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.724+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f0e5813ccd0 con 0x7f0e580ad660 2024-03-23T23:59:13.930 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.926+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0e580752c0 con 0x7f0e580ad660 2024-03-23T23:59:13.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.933+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0e4c059140 con 0x7f0e580ad660 2024-03-23T23:59:13.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.935+0000 7f0e55600640 1 -- 172.21.15.31:0/2756381113 <== mon.0 v2:172.21.15.31:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e4c058a40 con 0x7f0e580ad660 2024-03-23T23:59:13.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0e3806bbd0 msgr2=0x7f0e3806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0e3806bbd0 0x7f0e3806e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e5809d7e0 tx=0x7f0e44008040 comp rx=0 tx=0).stop 2024-03-23T23:59:13.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 msgr2=0x7f0e5813b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:13.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e5813b640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c430 tx=0x7f0e4c00c8f0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 shutdown_connections 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f0e3806bbd0 0x7f0e3806e090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580b3040 0x7f0e5813c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580b57d0 0x7f0e58143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 --2- 172.21.15.31:0/2756381113 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0e580ad660 0x7f0e5813b640 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 >> 172.21.15.31:0/2756381113 conn(0x7f0e5806be60 msgr2=0x7f0e58068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 shutdown_connections 2024-03-23T23:59:13.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:13.938+0000 7f0e5ec00640 1 -- 172.21.15.31:0/2756381113 wait complete. 2024-03-23T23:59:13.957 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-23T23:59:13.957 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:59:14.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.185+0000 7f19bfe00640 1 Processor -- start 2024-03-23T23:59:14.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.185+0000 7f19bfe00640 1 -- start start 2024-03-23T23:59:14.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f19c00b41b0 0x7f19c00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bfe00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c00b6d30 0x7f19c01471e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bfe00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00b4590 con 0x7f19c0147720 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bfe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c00b56c0 con 0x7f19c00b41b0 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bfe00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00b9930 con 0x7f19c00b6d30 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bf400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f19c0147720 0x7f19c0140e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34684/0 (socket says 172.21.15.31:34684) 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bf400640 1 -- 172.21.15.31:0/1808895005 learned_addr learned my addr 172.21.15.31:0/1808895005 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19be000640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c00b6d30 0x7f19c01471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bea00640 1 --2- 172.21.15.31:0/1808895005 >> v2:172.21.15.59:3300/0 conn(0x7f19c00b41b0 0x7f19c00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.187+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850071493 0 0) 0x7f19c00b4590 con 0x7f19c0147720 2024-03-23T23:59:14.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a4003520 con 0x7f19c0147720 2024-03-23T23:59:14.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1840479004 0 0) 0x7f19a4003520 con 0x7f19c0147720 2024-03-23T23:59:14.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c00b6d30 msgr2=0x7f19c01471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:14.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c00b6d30 0x7f19c01471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 >> v2:172.21.15.59:3300/0 conn(0x7f19c00b41b0 msgr2=0x7f19c00b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 --2- 172.21.15.31:0/1808895005 >> v2:172.21.15.59:3300/0 conn(0x7f19c00b41b0 0x7f19c00b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c00b9c10 con 0x7f19c0147720 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f19b80019f0 con 0x7f19c0147720 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 >> v1:172.21.15.31:6789/0 conn(0x7f19c0147720 legacy=0x7f19c0140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4003a20 0x7f19a4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a4004800 0x7f19a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a40051c0 0x7f19a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00b56c0 con 0x7f19a4004800 2024-03-23T23:59:14.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00b9930 con 0x7f19a4003a20 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a400bf00 con 0x7f19a40051c0 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.188+0000 7f19be000640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a4004800 0x7f19a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.189+0000 7f19bea00640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4003a20 0x7f19a4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.189+0000 7f19be000640 1 -- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a40051c0 msgr2=0x7f19a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.189+0000 7f19be000640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19a40051c0 0x7f19a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.189+0000 7f19be000640 1 -- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4003a20 msgr2=0x7f19a4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.189+0000 7f19be000640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4003a20 0x7f19a4003e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.189+0000 7f19be000640 1 -- 172.21.15.31:0/1808895005 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4003520 con 0x7f19a4004800 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.190+0000 7f19be000640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a4004800 0x7f19a4004c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009af0 tx=0x7f19a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427eacca0b0a9b32 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.190+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac039070 con 0x7f19a4004800 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.190+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f19ac02c710 con 0x7f19a4004800 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.190+0000 7f19bd600640 1 -- 172.21.15.31:0/1808895005 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac009690 con 0x7f19a4004800 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.190+0000 7f19bfe00640 1 -- 172.21.15.31:0/1808895005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a4004800 msgr2=0x7f19a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.190+0000 7f19bfe00640 1 --2- 172.21.15.31:0/1808895005 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19a4004800 0x7f19a4004c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009af0 tx=0x7f19a4005830 comp rx=0 tx=0).stop 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.190+0000 7f19bf400640 1 -- 172.21.15.31:0/1808895005 reap_dead start 2024-03-23T23:59:14.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.191+0000 7f19bfe00640 1 -- 172.21.15.31:0/1808895005 shutdown_connections 2024-03-23T23:59:14.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.191+0000 7f19bfe00640 1 -- 172.21.15.31:0/1808895005 >> 172.21.15.31:0/1808895005 conn(0x7f19c0066fb0 msgr2=0x7f19c00673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:14.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.191+0000 7f19bfe00640 1 -- 172.21.15.31:0/1808895005 shutdown_connections 2024-03-23T23:59:14.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.191+0000 7f19bfe00640 1 -- 172.21.15.31:0/1808895005 wait complete. 2024-03-23T23:59:14.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.192+0000 7f19bfe00640 1 Processor -- start 2024-03-23T23:59:14.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.192+0000 7f19bfe00640 1 -- start start 2024-03-23T23:59:14.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4004800 0x7f19c00bce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19bfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c0141af0 0x7f19c01dc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19bfe00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c01dccc0 0x7f19c01444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19bfe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0147360 con 0x7f19c0141af0 2024-03-23T23:59:14.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19bfe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01471e0 con 0x7f19a4004800 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19bfe00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01474e0 con 0x7f19c01dccc0 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19be000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c0141af0 0x7f19c01dc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19be000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c0141af0 0x7f19c01dc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58228/0 (socket says 172.21.15.31:58228) 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.193+0000 7f19be000640 1 -- 172.21.15.31:0/1200015144 learned_addr learned my addr 172.21.15.31:0/1200015144 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19bea00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4004800 0x7f19c00bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19be000640 1 -- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c01dccc0 msgr2=0x7f19c01444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19bf400640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c01dccc0 0x7f19c01444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19be000640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c01dccc0 0x7f19c01444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19be000640 1 -- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4004800 msgr2=0x7f19c00bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19be000640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4004800 0x7f19c00bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19be000640 1 -- 172.21.15.31:0/1200015144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0142b20 con 0x7f19c0141af0 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19bea00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4004800 0x7f19c00bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19be000640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c0141af0 0x7f19c01dc780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19ac037040 tx=0x7f19ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19b6a00640 1 -- 172.21.15.31:0/1200015144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac039050 con 0x7f19c0141af0 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19b6a00640 1 -- 172.21.15.31:0/1200015144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f19ac045070 con 0x7f19c0141af0 2024-03-23T23:59:14.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19b6a00640 1 -- 172.21.15.31:0/1200015144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac003a70 con 0x7f19c0141af0 2024-03-23T23:59:14.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.194+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c0149e40 con 0x7f19c0141af0 2024-03-23T23:59:14.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.195+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c00bd6e0 con 0x7f19c0141af0 2024-03-23T23:59:14.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.196+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c00752c0 con 0x7f19c0141af0 2024-03-23T23:59:14.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.197+0000 7f19b6a00640 1 -- 172.21.15.31:0/1200015144 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f19ac003c10 con 0x7f19c0141af0 2024-03-23T23:59:14.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.198+0000 7f19b6a00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f19a006bbd0 0x7f19a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.198+0000 7f19b6a00640 1 -- 172.21.15.31:0/1200015144 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f19ac0ac680 con 0x7f19c0141af0 2024-03-23T23:59:14.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.199+0000 7f19bea00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f19a006bbd0 0x7f19a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.200+0000 7f19bea00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f19a006bbd0 0x7f19a006e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009a60 tx=0x7f19b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:14.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.203+0000 7f19b6a00640 1 -- 172.21.15.31:0/1200015144 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f19ac04e020 con 0x7f19c0141af0 2024-03-23T23:59:14.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.445+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19c01455d0 con 0x7f19c0141af0 2024-03-23T23:59:14.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.446+0000 7f19b6a00640 1 -- 172.21.15.31:0/1200015144 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3388 (secure 0 0 0) 0x7f19ac07b030 con 0x7f19c0141af0 2024-03-23T23:59:14.447 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:59:14.447 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/481677666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":481677666},{"type":"v1","addr":"172.21.15.31:6833","nonce":481677666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:56:30.337777+0000","modified":"2024-03-23T23:56:33.383201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3774186650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3774186650},{"type":"v1","addr":"172.21.15.59:6835","nonce":3774186650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-03-23T23:59:14.448 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-03-23T23:59:14.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f19a006bbd0 msgr2=0x7f19a006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f19a006bbd0 0x7f19a006e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009a60 tx=0x7f19b0008040 comp rx=0 tx=0).stop 2024-03-23T23:59:14.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c0141af0 msgr2=0x7f19c01dc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c0141af0 0x7f19c01dc780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19ac037040 tx=0x7f19ac004730 comp rx=0 tx=0).stop 2024-03-23T23:59:14.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 shutdown_connections 2024-03-23T23:59:14.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f19a006bbd0 0x7f19a006e090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19c01dccc0 0x7f19c01444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f19c0141af0 0x7f19c01dc780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 --2- 172.21.15.31:0/1200015144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19a4004800 0x7f19c00bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 >> 172.21.15.31:0/1200015144 conn(0x7f19c0066fb0 msgr2=0x7f19c00b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:14.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 shutdown_connections 2024-03-23T23:59:14.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.449+0000 7f19bfe00640 1 -- 172.21.15.31:0/1200015144 wait complete. 2024-03-23T23:59:14.469 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T23:59:14.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.696+0000 7ff1f2200640 1 Processor -- start 2024-03-23T23:59:14.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.697+0000 7ff1f2200640 1 -- start start 2024-03-23T23:59:14.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1f2200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec14af60 0x7ff1ec140b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1f2200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1ec0b9850 0x7ff1ec141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1f2200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ec0b3e60 con 0x7ff1ec0b5210 2024-03-23T23:59:14.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1f2200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b55f0 con 0x7ff1ec0b9850 2024-03-23T23:59:14.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1f2200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b9dc0 con 0x7ff1ec14af60 2024-03-23T23:59:14.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1f1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1ec0b9850 0x7ff1ec141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1e3e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec14af60 0x7ff1ec140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1e3e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec14af60 0x7ff1ec140b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60804/0 (socket says 172.21.15.31:60804) 2024-03-23T23:59:14.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.698+0000 7ff1e3e00640 1 -- 172.21.15.31:0/540068248 learned_addr learned my addr 172.21.15.31:0/540068248 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:14.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.699+0000 7ff1f1800640 1 -- 172.21.15.31:0/540068248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec14af60 msgr2=0x7ff1ec140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.699+0000 7ff1f1800640 1 --2- 172.21.15.31:0/540068248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec14af60 0x7ff1ec140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.699+0000 7ff1f1800640 1 -- 172.21.15.31:0/540068248 >> v1:172.21.15.59:6789/0 conn(0x7ff1ec0b5210 legacy=0x7ff1ec14a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.699+0000 7ff1f1800640 1 -- 172.21.15.31:0/540068248 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec0b4100 con 0x7ff1ec0b9850 2024-03-23T23:59:14.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.701+0000 7ff1f1800640 1 --2- 172.21.15.31:0/540068248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b9850 0x7ff1ec141060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009d90 tx=0x7ff1e402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2c4d28ae4bb113 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.701+0000 7ff1ebe00640 1 -- 172.21.15.31:0/540068248 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4039070 con 0x7ff1ec0b9850 2024-03-23T23:59:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.701+0000 7ff1ebe00640 1 -- 172.21.15.31:0/540068248 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff1e402cc50 con 0x7ff1ec0b9850 2024-03-23T23:59:14.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.701+0000 7ff1ebe00640 1 -- 172.21.15.31:0/540068248 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4034440 con 0x7ff1ec0b9850 2024-03-23T23:59:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 -- 172.21.15.31:0/540068248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b9850 msgr2=0x7ff1ec141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 --2- 172.21.15.31:0/540068248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b9850 0x7ff1ec141060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4009d90 tx=0x7ff1e402bea0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 -- 172.21.15.31:0/540068248 shutdown_connections 2024-03-23T23:59:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 --2- 172.21.15.31:0/540068248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b9850 0x7ff1ec141060 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 --2- 172.21.15.31:0/540068248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec14af60 0x7ff1ec140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 -- 172.21.15.31:0/540068248 >> 172.21.15.31:0/540068248 conn(0x7ff1ec066fb0 msgr2=0x7ff1ec0673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 -- 172.21.15.31:0/540068248 shutdown_connections 2024-03-23T23:59:14.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.702+0000 7ff1f2200640 1 -- 172.21.15.31:0/540068248 wait complete. 2024-03-23T23:59:14.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.704+0000 7ff1f2200640 1 Processor -- start 2024-03-23T23:59:14.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.704+0000 7ff1f2200640 1 -- start start 2024-03-23T23:59:14.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f2200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b5210 0x7ff1ec0b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f2200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec0b9850 0x7ff1ec13c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f2200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ec13e880 0x7ff1ec13ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f2200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b6d40 con 0x7ff1ec13e880 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f2200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b6bc0 con 0x7ff1ec0b5210 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f2200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec0b6ec0 con 0x7ff1ec0b9850 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f1800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ec13e880 0x7ff1ec13ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f1800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ec13e880 0x7ff1ec13ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40302/0 (socket says 172.21.15.31:40302) 2024-03-23T23:59:14.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f1800640 1 -- 172.21.15.31:0/653665820 learned_addr learned my addr 172.21.15.31:0/653665820 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f0e00640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b5210 0x7ff1ec0b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1e3e00640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec0b9850 0x7ff1ec13c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f1800640 1 -- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec0b9850 msgr2=0x7ff1ec13c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f1800640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec0b9850 0x7ff1ec13c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f1800640 1 -- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b5210 msgr2=0x7ff1ec0b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.705+0000 7ff1f1800640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b5210 0x7ff1ec0b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.706+0000 7ff1f1800640 1 -- 172.21.15.31:0/653665820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec13e110 con 0x7ff1ec13e880 2024-03-23T23:59:14.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.706+0000 7ff1f1800640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ec13e880 0x7ff1ec13ce00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4037040 tx=0x7ff1e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.706+0000 7ff1e9600640 1 -- 172.21.15.31:0/653665820 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e4039050 con 0x7ff1ec13e880 2024-03-23T23:59:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.706+0000 7ff1e9600640 1 -- 172.21.15.31:0/653665820 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff1e4045070 con 0x7ff1ec13e880 2024-03-23T23:59:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.706+0000 7ff1e9600640 1 -- 172.21.15.31:0/653665820 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e403e610 con 0x7ff1ec13e880 2024-03-23T23:59:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.706+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec13beb0 con 0x7ff1ec13e880 2024-03-23T23:59:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.706+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec149770 con 0x7ff1ec13e880 2024-03-23T23:59:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.708+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec0b6170 con 0x7ff1ec13e880 2024-03-23T23:59:14.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.709+0000 7ff1e9600640 1 -- 172.21.15.31:0/653665820 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff1e403e7d0 con 0x7ff1ec13e880 2024-03-23T23:59:14.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.710+0000 7ff1e9600640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff1c806bbd0 0x7ff1c806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:14.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.710+0000 7ff1e9600640 1 -- 172.21.15.31:0/653665820 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7ff1e40ad790 con 0x7ff1ec13e880 2024-03-23T23:59:14.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.710+0000 7ff1f0e00640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff1c806bbd0 0x7ff1c806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:14.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.711+0000 7ff1f0e00640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff1c806bbd0 0x7ff1c806e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc001640 tx=0x7ff1dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:14.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.714+0000 7ff1e9600640 1 -- 172.21.15.31:0/653665820 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7ff1ec0b6170 con 0x7ff1ec13e880 2024-03-23T23:59:14.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.955+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1ec0752c0 con 0x7ff1ec13e880 2024-03-23T23:59:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.956+0000 7ff1e9600640 1 -- 172.21.15.31:0/653665820 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3388 (secure 0 0 0) 0x7ff1e407c0b0 con 0x7ff1ec13e880 2024-03-23T23:59:14.957 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:59:14.957 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/481677666","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":481677666},{"type":"v1","addr":"172.21.15.31:6833","nonce":481677666}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T23:56:30.337777+0000","modified":"2024-03-23T23:56:33.383201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3774186650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3774186650},{"type":"v1","addr":"172.21.15.59:6835","nonce":3774186650}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4272,"qdb_cluster":[4272]},"id":1}]} 2024-03-23T23:59:14.957 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-03-23T23:59:14.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff1c806bbd0 msgr2=0x7ff1c806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff1c806bbd0 0x7ff1c806e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc001640 tx=0x7ff1dc009040 comp rx=0 tx=0).stop 2024-03-23T23:59:14.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ec13e880 msgr2=0x7ff1ec13ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:14.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ec13e880 0x7ff1ec13ce00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4037040 tx=0x7ff1e4004a40 comp rx=0 tx=0).stop 2024-03-23T23:59:14.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 shutdown_connections 2024-03-23T23:59:14.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7ff1c806bbd0 0x7ff1c806e090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff1ec13e880 0x7ff1ec13ce00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1ec0b9850 0x7ff1ec13c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 --2- 172.21.15.31:0/653665820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1ec0b5210 0x7ff1ec0b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:14.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.959+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 >> 172.21.15.31:0/653665820 conn(0x7ff1ec066fb0 msgr2=0x7ff1ec0bd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:14.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.960+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 shutdown_connections 2024-03-23T23:59:14.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:14.960+0000 7ff1f2200640 1 -- 172.21.15.31:0/653665820 wait complete. 2024-03-23T23:59:14.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T23:59:15.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.206+0000 7f4d2e200640 1 Processor -- start 2024-03-23T23:59:15.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.206+0000 7f4d2e200640 1 -- start start 2024-03-23T23:59:15.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d2e200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d28140e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d2e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d280b6c80 0x7f4d281413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d2e200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d280b56c0 con 0x7f4d28147080 2024-03-23T23:59:15.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d2e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280b45b0 con 0x7f4d280b6c80 2024-03-23T23:59:15.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d2e200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d280bcf20 con 0x7f4d280b52e0 2024-03-23T23:59:15.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d27e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d280b6c80 0x7f4d281413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d2ce00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d28140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d27e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d280b6c80 0x7f4d281413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:60338/0 (socket says 172.21.15.31:60338) 2024-03-23T23:59:15.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.208+0000 7f4d27e00640 1 -- 172.21.15.31:0/317658057 learned_addr learned my addr 172.21.15.31:0/317658057 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:15.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.209+0000 7f4d2ce00640 1 -- 172.21.15.31:0/317658057 >> v2:172.21.15.59:3300/0 conn(0x7f4d280b6c80 msgr2=0x7f4d281413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:15.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.209+0000 7f4d2ce00640 1 --2- 172.21.15.31:0/317658057 >> v2:172.21.15.59:3300/0 conn(0x7f4d280b6c80 0x7f4d281413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.209+0000 7f4d2ce00640 1 -- 172.21.15.31:0/317658057 >> v1:172.21.15.59:6789/0 conn(0x7f4d28147080 legacy=0x7f4d2814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.209+0000 7f4d2ce00640 1 -- 172.21.15.31:0/317658057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d280bd200 con 0x7f4d280b52e0 2024-03-23T23:59:15.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.209+0000 7f4d27400640 1 -- 172.21.15.31:0/317658057 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397669930 0 0) 0x7f4d280b56c0 con 0x7f4d28147080 2024-03-23T23:59:15.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.209+0000 7f4d27e00640 1 --2- 172.21.15.31:0/317658057 >> v2:172.21.15.59:3300/0 conn(0x7f4d280b6c80 0x7f4d281413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:15.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.211+0000 7f4d2ce00640 1 --2- 172.21.15.31:0/317658057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d28140e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d918a597dde0151d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:15.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.212+0000 7f4d27400640 1 -- 172.21.15.31:0/317658057 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c031780 con 0x7f4d280b52e0 2024-03-23T23:59:15.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.212+0000 7f4d27400640 1 -- 172.21.15.31:0/317658057 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d1c037070 con 0x7f4d280b52e0 2024-03-23T23:59:15.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.212+0000 7f4d27400640 1 -- 172.21.15.31:0/317658057 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c031b60 con 0x7f4d280b52e0 2024-03-23T23:59:15.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 -- 172.21.15.31:0/317658057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 msgr2=0x7f4d28140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 --2- 172.21.15.31:0/317658057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d28140e70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097a0 tx=0x7f4d1c02b820 comp rx=0 tx=0).stop 2024-03-23T23:59:15.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 -- 172.21.15.31:0/317658057 shutdown_connections 2024-03-23T23:59:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 --2- 172.21.15.31:0/317658057 >> v2:172.21.15.59:3300/0 conn(0x7f4d280b6c80 0x7f4d281413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 --2- 172.21.15.31:0/317658057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d28140e70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 -- 172.21.15.31:0/317658057 >> 172.21.15.31:0/317658057 conn(0x7f4d28066fb0 msgr2=0x7f4d280673c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 -- 172.21.15.31:0/317658057 shutdown_connections 2024-03-23T23:59:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.213+0000 7f4d2e200640 1 -- 172.21.15.31:0/317658057 wait complete. 2024-03-23T23:59:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.214+0000 7f4d2e200640 1 Processor -- start 2024-03-23T23:59:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.215+0000 7f4d2e200640 1 -- start start 2024-03-23T23:59:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.215+0000 7f4d2e200640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d2813f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.215+0000 7f4d2e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280b6c80 0x7f4d281e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.215+0000 7f4d2e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d28147080 0x7f4d2813bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.215+0000 7f4d2e200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d280b93a0 con 0x7f4d280b6c80 2024-03-23T23:59:15.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.215+0000 7f4d2e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d280b9220 con 0x7f4d28147080 2024-03-23T23:59:15.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.215+0000 7f4d2e200640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d280b3f20 con 0x7f4d280b52e0 2024-03-23T23:59:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.216+0000 7f4d27e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280b6c80 0x7f4d281e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.216+0000 7f4d27e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280b6c80 0x7f4d281e01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40308/0 (socket says 172.21.15.31:40308) 2024-03-23T23:59:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.216+0000 7f4d2ce00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d2813f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.216+0000 7f4d27e00640 1 -- 172.21.15.31:0/1730380469 learned_addr learned my addr 172.21.15.31:0/1730380469 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.216+0000 7f4d2d800640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d28147080 0x7f4d2813bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d27e00640 1 -- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 msgr2=0x7f4d2813f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d27e00640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d2813f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d27e00640 1 -- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d28147080 msgr2=0x7f4d2813bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d27e00640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d28147080 0x7f4d2813bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d27e00640 1 -- 172.21.15.31:0/1730380469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2813b080 con 0x7f4d280b6c80 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d27e00640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280b6c80 0x7f4d281e01e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400e9d0 tx=0x7f4d1400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d24c00640 1 -- 172.21.15.31:0/1730380469 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14017070 con 0x7f4d280b6c80 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d24c00640 1 -- 172.21.15.31:0/1730380469 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d1400ca60 con 0x7f4d280b6c80 2024-03-23T23:59:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d24c00640 1 -- 172.21.15.31:0/1730380469 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400ce30 con 0x7f4d280b6c80 2024-03-23T23:59:15.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2813b360 con 0x7f4d280b6c80 2024-03-23T23:59:15.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.217+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2813dd80 con 0x7f4d280b6c80 2024-03-23T23:59:15.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.218+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d280752c0 con 0x7f4d280b6c80 2024-03-23T23:59:15.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.220+0000 7f4d24c00640 1 -- 172.21.15.31:0/1730380469 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4d1401a070 con 0x7f4d280b6c80 2024-03-23T23:59:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.221+0000 7f4d24c00640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4d0806bc00 0x7f4d0806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.221+0000 7f4d24c00640 1 -- 172.21.15.31:0/1730380469 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f4d1408ace0 con 0x7f4d280b6c80 2024-03-23T23:59:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.222+0000 7f4d2ce00640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4d0806bc00 0x7f4d0806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.223+0000 7f4d2ce00640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4d0806bc00 0x7f4d0806e0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c036000 tx=0x7f4d1c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:15.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.226+0000 7f4d24c00640 1 -- 172.21.15.31:0/1730380469 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f4d14059170 con 0x7f4d280b6c80 2024-03-23T23:59:15.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.433+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d28146600 con 0x7f4d280b6c80 2024-03-23T23:59:15.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.434+0000 7f4d24c00640 1 -- 172.21.15.31:0/1730380469 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16842 (secure 0 0 0) 0x7f4d1405d210 con 0x7f4d280b6c80 2024-03-23T23:59:15.435 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-03-23T23:59:15.435 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"fsid":"6654f0f5-f55e-4e42-bb02-030326afa81f","created":"2024-03-23T23:56:03.997146+0000","modified":"2024-03-23T23:58:16.556971+0000","last_up_change":"2024-03-23T23:56:17.637450+0000","last_in_change":"2024-03-23T23:56:08.381329+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T23:56:19.394330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T23:56:27.885317+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T23:56:29.338633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"464a7c55-2a06-40ea-8482-78177113a61f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6811","nonce":2134439972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6816","nonce":2134439972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6824","nonce":2134439972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2134439972},{"type":"v1","addr":"172.21.15.31:6820","nonce":2134439972}]},"public_addr":"172.21.15.31:6811/2134439972","cluster_addr":"172.21.15.31:6816/2134439972","heartbeat_back_addr":"172.21.15.31:6824/2134439972","heartbeat_front_addr":"172.21.15.31:6820/2134439972","state":["exists","up"]},{"osd":1,"uuid":"f7a68ffa-141e-4319-9dcf-0135ccb438a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6801","nonce":2615987950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6803","nonce":2615987950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6807","nonce":2615987950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2615987950},{"type":"v1","addr":"172.21.15.31:6805","nonce":2615987950}]},"public_addr":"172.21.15.31:6801/2615987950","cluster_addr":"172.21.15.31:6803/2615987950","heartbeat_back_addr":"172.21.15.31:6807/2615987950","heartbeat_front_addr":"172.21.15.31:6805/2615987950","state":["exists","up"]},{"osd":2,"uuid":"0393bb76-6fe9-44fd-aa19-e1431efaab12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6810","nonce":636958187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6813","nonce":636958187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6819","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6821","nonce":636958187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6815","nonce":636958187},{"type":"v1","addr":"172.21.15.31:6817","nonce":636958187}]},"public_addr":"172.21.15.31:6810/636958187","cluster_addr":"172.21.15.31:6813/636958187","heartbeat_back_addr":"172.21.15.31:6821/636958187","heartbeat_front_addr":"172.21.15.31:6817/636958187","state":["exists","up"]},{"osd":3,"uuid":"9202a8ae-0c87-417d-99c4-33bfd8521be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6823","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6825","nonce":2450082534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6827","nonce":2450082534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6831","nonce":2450082534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":2450082534},{"type":"v1","addr":"172.21.15.31:6829","nonce":2450082534}]},"public_addr":"172.21.15.31:6825/2450082534","cluster_addr":"172.21.15.31:6827/2450082534","heartbeat_back_addr":"172.21.15.31:6831/2450082534","heartbeat_front_addr":"172.21.15.31:6829/2450082534","state":["exists","up"]},{"osd":4,"uuid":"ac629292-9951-4570-866a-fd09ad372056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6819","nonce":2529462705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6821","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6823","nonce":2529462705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6829","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6831","nonce":2529462705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6825","nonce":2529462705},{"type":"v1","addr":"172.21.15.59:6827","nonce":2529462705}]},"public_addr":"172.21.15.59:6819/2529462705","cluster_addr":"172.21.15.59:6823/2529462705","heartbeat_back_addr":"172.21.15.59:6831/2529462705","heartbeat_front_addr":"172.21.15.59:6827/2529462705","state":["exists","up"]},{"osd":5,"uuid":"5f26844a-4a5c-4778-9f44-d5ae00288e7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6801","nonce":814178259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6803","nonce":814178259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6807","nonce":814178259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":814178259},{"type":"v1","addr":"172.21.15.59:6805","nonce":814178259}]},"public_addr":"172.21.15.59:6801/814178259","cluster_addr":"172.21.15.59:6803/814178259","heartbeat_back_addr":"172.21.15.59:6807/814178259","heartbeat_front_addr":"172.21.15.59:6805/814178259","state":["exists","up"]},{"osd":6,"uuid":"9c7becfe-366a-45fd-8a13-f2b7a336482b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6818","nonce":807447559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6822","nonce":807447559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6830","nonce":807447559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":807447559},{"type":"v1","addr":"172.21.15.59:6826","nonce":807447559}]},"public_addr":"172.21.15.59:6818/807447559","cluster_addr":"172.21.15.59:6822/807447559","heartbeat_back_addr":"172.21.15.59:6830/807447559","heartbeat_front_addr":"172.21.15.59:6826/807447559","state":["exists","up"]},{"osd":7,"uuid":"9d6fb05f-9474-427e-99c6-3aaf270b8177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6809","nonce":1396029038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6811","nonce":1396029038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6815","nonce":1396029038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1396029038},{"type":"v1","addr":"172.21.15.59:6813","nonce":1396029038}]},"public_addr":"172.21.15.59:6809/1396029038","cluster_addr":"172.21.15.59:6811/1396029038","heartbeat_back_addr":"172.21.15.59:6815/1396029038","heartbeat_front_addr":"172.21.15.59:6813/1396029038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.749549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.651379+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.763477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.454104+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.703368+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.477317+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.708598+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T23:56:13.668640+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:0/824014188":"2024-03-24T00:58:16.116229+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T23:59:15.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4d0806bc00 msgr2=0x7f4d0806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4d0806bc00 0x7f4d0806e0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c036000 tx=0x7f4d1c03d040 comp rx=0 tx=0).stop 2024-03-23T23:59:15.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280b6c80 msgr2=0x7f4d281e01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280b6c80 0x7f4d281e01e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400e9d0 tx=0x7f4d1400ee90 comp rx=0 tx=0).stop 2024-03-23T23:59:15.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 shutdown_connections 2024-03-23T23:59:15.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f4d0806bc00 0x7f4d0806e0c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d28147080 0x7f4d2813bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.438 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280b6c80 0x7f4d281e01e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 --2- 172.21.15.31:0/1730380469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d280b52e0 0x7f4d2813f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.437+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 >> 172.21.15.31:0/1730380469 conn(0x7f4d28066fb0 msgr2=0x7f4d280b7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.438+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 shutdown_connections 2024-03-23T23:59:15.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.438+0000 7f4d2e200640 1 -- 172.21.15.31:0/1730380469 wait complete. 2024-03-23T23:59:15.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-23T23:59:15.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:15.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.683+0000 7f9577000640 1 Processor -- start 2024-03-23T23:59:15.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.683+0000 7f9577000640 1 -- start start 2024-03-23T23:59:15.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9577000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b7930 0x7f9570147760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9577000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95700af450 0x7f9570147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9577000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95700b7d10 con 0x7f95700b32c0 2024-03-23T23:59:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9577000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700b3900 con 0x7f95700af450 2024-03-23T23:59:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9577000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700b4d50 con 0x7f95700b7930 2024-03-23T23:59:15.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9576600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95700af450 0x7f9570147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9575200640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f95700b32c0 0x7f95700aed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56716/0 (socket says 172.21.15.31:56716) 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9575200640 1 -- 172.21.15.31:0/2325338496 learned_addr learned my addr 172.21.15.31:0/2325338496 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.685+0000 7f9575c00640 1 --2- 172.21.15.31:0/2325338496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b7930 0x7f9570147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.686+0000 7f9576600640 1 -- 172.21.15.31:0/2325338496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b7930 msgr2=0x7f9570147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.686+0000 7f9576600640 1 --2- 172.21.15.31:0/2325338496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b7930 0x7f9570147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.686+0000 7f9576600640 1 -- 172.21.15.31:0/2325338496 >> v1:172.21.15.31:6789/0 conn(0x7f95700b32c0 legacy=0x7f95700aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.686+0000 7f9576600640 1 -- 172.21.15.31:0/2325338496 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700b3b50 con 0x7f95700af450 2024-03-23T23:59:15.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.686+0000 7f956fe00640 1 -- 172.21.15.31:0/2325338496 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694209701 0 0) 0x7f95700b7d10 con 0x7f95700b32c0 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.687+0000 7f9576600640 1 --2- 172.21.15.31:0/2325338496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f9570147ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956802bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77f3395822e294f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.687+0000 7f956fe00640 1 -- 172.21.15.31:0/2325338496 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568039070 con 0x7f95700af450 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.687+0000 7f956fe00640 1 -- 172.21.15.31:0/2325338496 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f956802cb40 con 0x7f95700af450 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.687+0000 7f956fe00640 1 -- 172.21.15.31:0/2325338496 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568034440 con 0x7f95700af450 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 -- 172.21.15.31:0/2325338496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 msgr2=0x7f9570147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 --2- 172.21.15.31:0/2325338496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f9570147ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9568009d90 tx=0x7f956802bd90 comp rx=0 tx=0).stop 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 -- 172.21.15.31:0/2325338496 shutdown_connections 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 --2- 172.21.15.31:0/2325338496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f9570147ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 --2- 172.21.15.31:0/2325338496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b7930 0x7f9570147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 -- 172.21.15.31:0/2325338496 >> 172.21.15.31:0/2325338496 conn(0x7f957006cf40 msgr2=0x7f957006ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:15.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 -- 172.21.15.31:0/2325338496 shutdown_connections 2024-03-23T23:59:15.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.688+0000 7f9577000640 1 -- 172.21.15.31:0/2325338496 wait complete. 2024-03-23T23:59:15.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.690+0000 7f9577000640 1 Processor -- start 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.690+0000 7f9577000640 1 -- start start 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9577000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f95701d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9577000640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b32c0 0x7f95700b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9577000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95700b7930 0x7f95700b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9577000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95700b51f0 con 0x7f95700af450 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9577000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95700b49d0 con 0x7f95700b7930 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9577000640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700b5370 con 0x7f95700b32c0 2024-03-23T23:59:15.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9575c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f95701d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9575c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f95701d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40338/0 (socket says 172.21.15.31:40338) 2024-03-23T23:59:15.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9575c00640 1 -- 172.21.15.31:0/1066341679 learned_addr learned my addr 172.21.15.31:0/1066341679 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:15.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9575200640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b32c0 0x7f95700b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.691+0000 7f9576600640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95700b7930 0x7f95700b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9575c00640 1 -- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b32c0 msgr2=0x7f95700b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9575c00640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b32c0 0x7f95700b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9575c00640 1 -- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95700b7930 msgr2=0x7f95700b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9575c00640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95700b7930 0x7f95700b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9575c00640 1 -- 172.21.15.31:0/1066341679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95701d1d70 con 0x7f95700af450 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9575200640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b32c0 0x7f95700b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9576600640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95700b7930 0x7f95700b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9575c00640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f95701d15b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f956400d5f0 tx=0x7f956400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f956d600640 1 -- 172.21.15.31:0/1066341679 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640125f0 con 0x7f95700af450 2024-03-23T23:59:15.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f956d600640 1 -- 172.21.15.31:0/1066341679 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9564019070 con 0x7f95700af450 2024-03-23T23:59:15.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f956d600640 1 -- 172.21.15.31:0/1066341679 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95640129f0 con 0x7f95700af450 2024-03-23T23:59:15.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95700b19b0 con 0x7f95700af450 2024-03-23T23:59:15.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.692+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95700b1f60 con 0x7f95700af450 2024-03-23T23:59:15.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.694+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700752c0 con 0x7f95700af450 2024-03-23T23:59:15.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.695+0000 7f956d600640 1 -- 172.21.15.31:0/1066341679 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9564012b90 con 0x7f95700af450 2024-03-23T23:59:15.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.695+0000 7f956d600640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955006bbd0 0x7f955006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:15.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.696+0000 7f956d600640 1 -- 172.21.15.31:0/1066341679 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5868+0+0 (secure 0 0 0) 0x7f956408af20 con 0x7f95700af450 2024-03-23T23:59:15.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.696+0000 7f9575200640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955006bbd0 0x7f955006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:15.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.698+0000 7f9575200640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955006bbd0 0x7f955006e090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95701deca0 tx=0x7f955c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:15.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.701+0000 7f956d600640 1 -- 172.21.15.31:0/1066341679 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f9564059960 con 0x7f95700af450 2024-03-23T23:59:15.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.946+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f957006bd10 con 0x7f95700af450 2024-03-23T23:59:15.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.950+0000 7f956d600640 1 -- 172.21.15.31:0/1066341679 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9564059260 con 0x7f95700af450 2024-03-23T23:59:15.950 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-23T23:59:15.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.952+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955006bbd0 msgr2=0x7f955006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.952+0000 7f9577000640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955006bbd0 0x7f955006e090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f95701deca0 tx=0x7f955c009040 comp rx=0 tx=0).stop 2024-03-23T23:59:15.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.952+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 msgr2=0x7f95701d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:15.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.952+0000 7f9577000640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f95701d15b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f956400d5f0 tx=0x7f956400dab0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 shutdown_connections 2024-03-23T23:59:15.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f955006bbd0 0x7f955006e090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95700b7930 0x7f95700b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95700b32c0 0x7f95700b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 --2- 172.21.15.31:0/1066341679 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95700af450 0x7f95701d15b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:15.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 >> 172.21.15.31:0/1066341679 conn(0x7f957006cf40 msgr2=0x7f9570098800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:15.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 shutdown_connections 2024-03-23T23:59:15.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:15.953+0000 7f9577000640 1 -- 172.21.15.31:0/1066341679 wait complete. 2024-03-23T23:59:15.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-23T23:59:16.084 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2024-03-23T23:59:16.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.187+0000 7fd5c5e00640 1 Processor -- start 2024-03-23T23:59:16.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.187+0000 7fd5c5e00640 1 -- start start 2024-03-23T23:59:16.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5c5e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5c00b6b50 0x7fd5c0141340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:16.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5c5e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5c00b9810 0x7fd5c0147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:16.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5c5e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00b9330 con 0x7fd5c00b50a0 2024-03-23T23:59:16.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5c5e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c0141880 con 0x7fd5c00b6b50 2024-03-23T23:59:16.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5c5e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c0147660 con 0x7fd5c00b9810 2024-03-23T23:59:16.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5bfe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5c00b6b50 0x7fd5c0141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:16.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5bfe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5c00b6b50 0x7fd5c0141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40348/0 (socket says 172.21.15.31:40348) 2024-03-23T23:59:16.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3810365620 learned_addr learned my addr 172.21.15.31:0/3810365620 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:16.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.189+0000 7fd5c5400640 1 --2- 172.21.15.31:0/3810365620 >> v2:172.21.15.59:3300/0 conn(0x7fd5c00b9810 0x7fd5c0147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:16.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.190+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3810365620 >> v2:172.21.15.59:3300/0 conn(0x7fd5c00b9810 msgr2=0x7fd5c0147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:16.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.190+0000 7fd5bfe00640 1 --2- 172.21.15.31:0/3810365620 >> v2:172.21.15.59:3300/0 conn(0x7fd5c00b9810 0x7fd5c0147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.190+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3810365620 >> v1:172.21.15.59:6789/0 conn(0x7fd5c00b50a0 legacy=0x7fd5c0140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:16.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.190+0000 7fd5bfe00640 1 -- 172.21.15.31:0/3810365620 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00b5480 con 0x7fd5c00b6b50 2024-03-23T23:59:16.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.191+0000 7fd5bfe00640 1 --2- 172.21.15.31:0/3810365620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b6b50 0x7fd5c0141340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0148200 tx=0x7fd5a802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ac544210f0ebb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:16.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.191+0000 7fd5bf400640 1 -- 172.21.15.31:0/3810365620 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a802ca80 con 0x7fd5c00b6b50 2024-03-23T23:59:16.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.191+0000 7fd5bf400640 1 -- 172.21.15.31:0/3810365620 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd5a802cc20 con 0x7fd5c00b6b50 2024-03-23T23:59:16.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.191+0000 7fd5bf400640 1 -- 172.21.15.31:0/3810365620 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80343f0 con 0x7fd5c00b6b50 2024-03-23T23:59:16.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 -- 172.21.15.31:0/3810365620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b6b50 msgr2=0x7fd5c0141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:16.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/3810365620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b6b50 0x7fd5c0141340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0148200 tx=0x7fd5a802bee0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 -- 172.21.15.31:0/3810365620 shutdown_connections 2024-03-23T23:59:16.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/3810365620 >> v2:172.21.15.59:3300/0 conn(0x7fd5c00b9810 0x7fd5c0147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/3810365620 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b6b50 0x7fd5c0141340 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 -- 172.21.15.31:0/3810365620 >> 172.21.15.31:0/3810365620 conn(0x7fd5c0066dd0 msgr2=0x7fd5c00671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:16.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 -- 172.21.15.31:0/3810365620 shutdown_connections 2024-03-23T23:59:16.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.192+0000 7fd5c5e00640 1 -- 172.21.15.31:0/3810365620 wait complete. 2024-03-23T23:59:16.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.194+0000 7fd5c5e00640 1 Processor -- start 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.194+0000 7fd5c5e00640 1 -- start start 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5e00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5c00b50a0 0x7fd5c00bc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5c00b6b50 0x7fd5c01dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b9810 0x7fd5c01e0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00b4000 con 0x7fd5c00b9810 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00b63e0 con 0x7fd5c00b6b50 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5e00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00b42e0 con 0x7fd5c00b50a0 2024-03-23T23:59:16.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b9810 0x7fd5c01e0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:16.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b9810 0x7fd5c01e0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40354/0 (socket says 172.21.15.31:40354) 2024-03-23T23:59:16.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5400640 1 -- 172.21.15.31:0/495642573 learned_addr learned my addr 172.21.15.31:0/495642573 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:16.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5bfe00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5c00b6b50 0x7fd5c01dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:16.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c4a00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5c00b50a0 0x7fd5c00bc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:16.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.195+0000 7fd5c5400640 1 -- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5c00b50a0 msgr2=0x7fd5c00bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:16.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5c5400640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5c00b50a0 0x7fd5c00bc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5c5400640 1 -- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5c00b6b50 msgr2=0x7fd5c01dccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:16.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5c5400640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5c00b6b50 0x7fd5c01dccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5c5400640 1 -- 172.21.15.31:0/495642573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c014a070 con 0x7fd5c00b9810 2024-03-23T23:59:16.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5bfe00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5c00b6b50 0x7fd5c01dccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T23:59:16.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5c5400640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b9810 0x7fd5c01e0240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800e7f0 tx=0x7fd5b800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:16.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5bcc00640 1 -- 172.21.15.31:0/495642573 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8017070 con 0x7fd5c00b9810 2024-03-23T23:59:16.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5bcc00640 1 -- 172.21.15.31:0/495642573 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd5b800ee40 con 0x7fd5c00b9810 2024-03-23T23:59:16.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c014abd0 con 0x7fd5c00b9810 2024-03-23T23:59:16.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5bcc00640 1 -- 172.21.15.31:0/495642573 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800cba0 con 0x7fd5c00b9810 2024-03-23T23:59:16.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.196+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c00bd520 con 0x7fd5c00b9810 2024-03-23T23:59:16.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.198+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c0142380 con 0x7fd5c00b9810 2024-03-23T23:59:16.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.199+0000 7fd5bcc00640 1 -- 172.21.15.31:0/495642573 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd5b801a070 con 0x7fd5c00b9810 2024-03-23T23:59:16.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.199+0000 7fd5bcc00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd59c06bbd0 0x7fd59c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:16.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.200+0000 7fd5bcc00640 1 -- 172.21.15.31:0/495642573 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5954+0+0 (secure 0 0 0) 0x7fd5b808aaa0 con 0x7fd5c00b9810 2024-03-23T23:59:16.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.200+0000 7fd5c4a00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd59c06bbd0 0x7fd59c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:16.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.201+0000 7fd5c4a00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd59c06bbd0 0x7fd59c06e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000f60 tx=0x7fd5b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:16.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.204+0000 7fd5bcc00640 1 -- 172.21.15.31:0/495642573 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fd5c0142380 con 0x7fd5c00b9810 2024-03-23T23:59:16.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.454+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd5c00752c0 con 0x7fd5c00b9810 2024-03-23T23:59:16.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.957+0000 7fd5bcc00640 1 -- 172.21.15.31:0/495642573 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd5b8059480 con 0x7fd5c00b9810 2024-03-23T23:59:16.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.960+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd59c06bbd0 msgr2=0x7fd59c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.960+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd59c06bbd0 0x7fd59c06e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000f60 tx=0x7fd5b0009040 comp rx=0 tx=0).stop 2024-03-23T23:59:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.960+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b9810 msgr2=0x7fd5c01e0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.960+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b9810 0x7fd5c01e0240 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800e7f0 tx=0x7fd5b800ebf0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 shutdown_connections 2024-03-23T23:59:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fd59c06bbd0 0x7fd59c06e090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5c00b6b50 0x7fd5c01dccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5c00b9810 0x7fd5c01e0240 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 --2- 172.21.15.31:0/495642573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5c00b50a0 0x7fd5c00bc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:16.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 >> 172.21.15.31:0/495642573 conn(0x7fd5c0066dd0 msgr2=0x7fd5c0141a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:16.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 shutdown_connections 2024-03-23T23:59:16.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:16.961+0000 7fd5c5e00640 1 -- 172.21.15.31:0/495642573 wait complete. 2024-03-23T23:59:16.983 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-23T23:59:17.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.211+0000 7f35aec00640 1 Processor -- start 2024-03-23T23:59:17.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.211+0000 7f35aec00640 1 -- start start 2024-03-23T23:59:17.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.212+0000 7f35aec00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 0x7f35a80ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.212+0000 7f35aec00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a8073470 con 0x7f35a8144570 2024-03-23T23:59:17.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.212+0000 7f35aec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80b42a0 con 0x7f35a8073090 2024-03-23T23:59:17.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.212+0000 7f35aec00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80b4050 con 0x7f35a80ad710 2024-03-23T23:59:17.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.212+0000 7f35ae200640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f35a8144570 0x7f35a814e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56726/0 (socket says 172.21.15.31:56726) 2024-03-23T23:59:17.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.212+0000 7f35ae200640 1 -- 172.21.15.31:0/1158231258 learned_addr learned my addr 172.21.15.31:0/1158231258 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-03-23T23:59:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35ace00640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 0x7f35a80ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085299411 0 0) 0x7f35a8073470 con 0x7f35a8144570 2024-03-23T23:59:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3590003520 con 0x7f35a8144570 2024-03-23T23:59:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 988116556 0 0) 0x7f3590003520 con 0x7f35a8144570 2024-03-23T23:59:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 msgr2=0x7f35a80ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 0x7f35a80ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 >> v1:172.21.15.59:6789/0 conn(0x7f35a8073090 legacy=0x7f35a80aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8143e90 con 0x7f35a8144570 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 544676333 0 0) 0x7f35a00019f0 con 0x7f35a8144570 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 >> v1:172.21.15.31:6789/0 conn(0x7f35a8144570 legacy=0x7f35a814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3590003a50 0x7f3590003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3590004800 0x7f3590004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.213+0000 7f35a7e00640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 0x7f359000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80b4050 con 0x7f3590003a50 2024-03-23T23:59:17.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3590005500 con 0x7f3590004800 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359000bf00 con 0x7f35a80ad710 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ad800640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3590003a50 0x7f3590003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ae200640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 0x7f359000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ace00640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3590004800 0x7f3590004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ad800640 1 -- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 msgr2=0x7f359000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ad800640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a80ad710 0x7f359000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ad800640 1 -- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3590004800 msgr2=0x7f3590004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ad800640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3590004800 0x7f3590004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.214+0000 7f35ad800640 1 -- 172.21.15.31:0/1158231258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3590003520 con 0x7f3590003a50 2024-03-23T23:59:17.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.215+0000 7f35ad800640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3590003a50 0x7f3590003e70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f359c001750 tx=0x7f3590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d087de73ce1f0fec server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c001370 con 0x7f3590003a50 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f359c0052d0 con 0x7f3590003a50 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35a7e00640 1 -- 172.21.15.31:0/1158231258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c003850 con 0x7f3590003a50 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35aec00640 1 -- 172.21.15.31:0/1158231258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3590003a50 msgr2=0x7f3590003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35aec00640 1 --2- 172.21.15.31:0/1158231258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3590003a50 0x7f3590003e70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f359c001750 tx=0x7f3590005830 comp rx=0 tx=0).stop 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35ae200640 1 -- 172.21.15.31:0/1158231258 reap_dead start 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35aec00640 1 -- 172.21.15.31:0/1158231258 shutdown_connections 2024-03-23T23:59:17.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.216+0000 7f35aec00640 1 -- 172.21.15.31:0/1158231258 >> 172.21.15.31:0/1158231258 conn(0x7f35a806b990 msgr2=0x7f35a806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:17.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.217+0000 7f35aec00640 1 -- 172.21.15.31:0/1158231258 shutdown_connections 2024-03-23T23:59:17.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.217+0000 7f35aec00640 1 -- 172.21.15.31:0/1158231258 wait complete. 2024-03-23T23:59:17.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.218+0000 7f35aec00640 1 Processor -- start 2024-03-23T23:59:17.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.218+0000 7f35aec00640 1 -- start start 2024-03-23T23:59:17.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35aec00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3590003a50 0x7f35a81dc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35aec00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a80b7e70 0x7f35a81d64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35aec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a81d6a00 0x7f35a8144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35aec00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8144b50 con 0x7f35a80b7e70 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35aec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a81449d0 con 0x7f35a81d6a00 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35aec00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8144cd0 con 0x7f3590003a50 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35ace00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a80b7e70 0x7f35a81d64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35ace00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a80b7e70 0x7f35a81d64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40376/0 (socket says 172.21.15.31:40376) 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.219+0000 7f35ace00640 1 -- 172.21.15.31:0/2885824447 learned_addr learned my addr 172.21.15.31:0/2885824447 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ad800640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3590003a50 0x7f35a81dc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ae200640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a81d6a00 0x7f35a8144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ace00640 1 -- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3590003a50 msgr2=0x7f35a81dc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ace00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3590003a50 0x7f35a81dc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ace00640 1 -- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a81d6a00 msgr2=0x7f35a8144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ace00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a81d6a00 0x7f35a8144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ace00640 1 -- 172.21.15.31:0/2885824447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a81463a0 con 0x7f35a80b7e70 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35ace00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a80b7e70 0x7f35a81d64c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3594010890 tx=0x7f3594010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35a5600640 1 -- 172.21.15.31:0/2885824447 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400f040 con 0x7f35a80b7e70 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35a5600640 1 -- 172.21.15.31:0/2885824447 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f359400eb60 con 0x7f35a80b7e70 2024-03-23T23:59:17.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35a5600640 1 -- 172.21.15.31:0/2885824447 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359401c400 con 0x7f35a80b7e70 2024-03-23T23:59:17.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.220+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a81dcc60 con 0x7f35a80b7e70 2024-03-23T23:59:17.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.221+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a81401a0 con 0x7f35a80b7e70 2024-03-23T23:59:17.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.222+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a80752c0 con 0x7f35a80b7e70 2024-03-23T23:59:17.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.223+0000 7f35a5600640 1 -- 172.21.15.31:0/2885824447 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f359401c5a0 con 0x7f35a80b7e70 2024-03-23T23:59:17.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.223+0000 7f35a5600640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f358806bc00 0x7f358806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:17.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.224+0000 7f35a5600640 1 -- 172.21.15.31:0/2885824447 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f359408b0e0 con 0x7f35a80b7e70 2024-03-23T23:59:17.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.224+0000 7f35ad800640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f358806bc00 0x7f358806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:17.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.225+0000 7f35ad800640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f358806bc00 0x7f358806e0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f359c033000 tx=0x7f359c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:17.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.228+0000 7f35a5600640 1 -- 172.21.15.31:0/2885824447 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7f3594018030 con 0x7f35a80b7e70 2024-03-23T23:59:17.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.429+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35a806b2c0 con 0x7f35a80b7e70 2024-03-23T23:59:17.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.968+0000 7f35a5600640 1 -- 172.21.15.31:0/2885824447 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3594059ad0 con 0x7f35a80b7e70 2024-03-23T23:59:17.968 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-03-23T23:59:17.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.972+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f358806bc00 msgr2=0x7f358806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:17.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.972+0000 7f35aec00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f358806bc00 0x7f358806e0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f359c033000 tx=0x7f359c009030 comp rx=0 tx=0).stop 2024-03-23T23:59:17.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.972+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a80b7e70 msgr2=0x7f35a81d64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:17.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.972+0000 7f35aec00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a80b7e70 0x7f35a81d64c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3594010890 tx=0x7f3594010d50 comp rx=0 tx=0).stop 2024-03-23T23:59:17.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.974+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 shutdown_connections 2024-03-23T23:59:17.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.974+0000 7f35aec00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7f358806bc00 0x7f358806e0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.974+0000 7f35aec00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a81d6a00 0x7f35a8144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.974+0000 7f35aec00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a80b7e70 0x7f35a81d64c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.974+0000 7f35aec00640 1 --2- 172.21.15.31:0/2885824447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3590003a50 0x7f35a81dc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:17.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.974+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 >> 172.21.15.31:0/2885824447 conn(0x7f35a806b990 msgr2=0x7f35a80b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:17.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.975+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 shutdown_connections 2024-03-23T23:59:17.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:17.975+0000 7f35aec00640 1 -- 172.21.15.31:0/2885824447 wait complete. 2024-03-23T23:59:17.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-23T23:59:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.222+0000 7fe4a5a00640 1 Processor -- start 2024-03-23T23:59:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.222+0000 7fe4a5a00640 1 -- start start 2024-03-23T23:59:18.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.223+0000 7fe4a5a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0072620 0x7fe4a00b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:18.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.223+0000 7fe4a5a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4a0071bb0 0x7fe4a01485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.223+0000 7fe4a5a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a0072a00 con 0x7fe4a00b7f10 2024-03-23T23:59:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.223+0000 7fe4a5a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a0070f20 con 0x7fe4a0071bb0 2024-03-23T23:59:18.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.223+0000 7fe4a5a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a0071200 con 0x7fe4a0072620 2024-03-23T23:59:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.224+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0072620 0x7fe4a00b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.224+0000 7fe49f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4a0071bb0 0x7fe4a01485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.224+0000 7fe49fe00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0072620 0x7fe4a00b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.31:60896/0 (socket says 172.21.15.31:60896) 2024-03-23T23:59:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.224+0000 7fe49f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4a0071bb0 0x7fe4a01485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.31:60386/0 (socket says 172.21.15.31:60386) 2024-03-23T23:59:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.224+0000 7fe49fe00640 1 -- 172.21.15.31:0/670842409 learned_addr learned my addr 172.21.15.31:0/670842409 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.225+0000 7fe49fe00640 1 -- 172.21.15.31:0/670842409 >> v2:172.21.15.59:3300/0 conn(0x7fe4a0071bb0 msgr2=0x7fe4a01485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.225+0000 7fe49fe00640 1 --2- 172.21.15.31:0/670842409 >> v2:172.21.15.59:3300/0 conn(0x7fe4a0071bb0 0x7fe4a01485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.225+0000 7fe49fe00640 1 -- 172.21.15.31:0/670842409 >> v1:172.21.15.59:6789/0 conn(0x7fe4a00b7f10 legacy=0x7fe4a013ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T23:59:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.225+0000 7fe49fe00640 1 -- 172.21.15.31:0/670842409 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a00b7230 con 0x7fe4a0072620 2024-03-23T23:59:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.225+0000 7fe49f400640 1 --2- 172.21.15.31:0/670842409 >> v2:172.21.15.59:3300/0 conn(0x7fe4a0071bb0 0x7fe4a01485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T23:59:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.226+0000 7fe49fe00640 1 --2- 172.21.15.31:0/670842409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0072620 0x7fe4a00b1900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe490009870 tx=0x7fe49002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7cc287479ba087c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.227+0000 7fe49ea00640 1 -- 172.21.15.31:0/670842409 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490035020 con 0x7fe4a0072620 2024-03-23T23:59:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.227+0000 7fe49ea00640 1 -- 172.21.15.31:0/670842409 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe490031640 con 0x7fe4a0072620 2024-03-23T23:59:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.227+0000 7fe49ea00640 1 -- 172.21.15.31:0/670842409 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49002d040 con 0x7fe4a0072620 2024-03-23T23:59:18.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 -- 172.21.15.31:0/670842409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0072620 msgr2=0x7fe4a00b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:18.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/670842409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0072620 0x7fe4a00b1900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe490009870 tx=0x7fe49002b8f0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 -- 172.21.15.31:0/670842409 shutdown_connections 2024-03-23T23:59:18.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/670842409 >> v2:172.21.15.59:3300/0 conn(0x7fe4a0071bb0 0x7fe4a01485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/670842409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0072620 0x7fe4a00b1900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 -- 172.21.15.31:0/670842409 >> 172.21.15.31:0/670842409 conn(0x7fe4a0067220 msgr2=0x7fe4a0067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:18.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 -- 172.21.15.31:0/670842409 shutdown_connections 2024-03-23T23:59:18.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.228+0000 7fe4a5a00640 1 -- 172.21.15.31:0/670842409 wait complete. 2024-03-23T23:59:18.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.230+0000 7fe4a5a00640 1 Processor -- start 2024-03-23T23:59:18.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.230+0000 7fe4a5a00640 1 -- start start 2024-03-23T23:59:18.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe4a5a00640 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0071bb0 0x7fe4a01dd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:18.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe4a5a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a0072620 0x7fe4a01404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:18.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe4a5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00b7f10 0x7fe4a0140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:18.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe4a5a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014f8f0 con 0x7fe4a0072620 2024-03-23T23:59:18.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe4a5a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a013f8b0 con 0x7fe4a00b7f10 2024-03-23T23:59:18.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe4a5a00640 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014fa70 con 0x7fe4a0071bb0 2024-03-23T23:59:18.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a0072620 0x7fe4a01404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:18.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a0072620 0x7fe4a01404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:40382/0 (socket says 172.21.15.31:40382) 2024-03-23T23:59:18.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49f400640 1 -- 172.21.15.31:0/34494500 learned_addr learned my addr 172.21.15.31:0/34494500 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-03-23T23:59:18.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49f400640 1 -- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0071bb0 msgr2=0x7fe4a01dd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:18.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49fe00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0071bb0 0x7fe4a01dd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:18.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe4a5000640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00b7f10 0x7fe4a0140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:18.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49f400640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0071bb0 0x7fe4a01dd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49f400640 1 -- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00b7f10 msgr2=0x7fe4a0140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.231+0000 7fe49f400640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00b7f10 0x7fe4a0140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe49f400640 1 -- 172.21.15.31:0/34494500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a013be10 con 0x7fe4a0072620 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe4a5000640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00b7f10 0x7fe4a0140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe49f400640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a0072620 0x7fe4a01404d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe48800ebe0 tx=0x7fe48800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe497e00640 1 -- 172.21.15.31:0/34494500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488017070 con 0x7fe4a0072620 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe497e00640 1 -- 172.21.15.31:0/34494500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe48800cc30 con 0x7fe4a0072620 2024-03-23T23:59:18.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe497e00640 1 -- 172.21.15.31:0/34494500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488013470 con 0x7fe4a0072620 2024-03-23T23:59:18.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a00b1770 con 0x7fe4a0072620 2024-03-23T23:59:18.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.232+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a00b46d0 con 0x7fe4a0072620 2024-03-23T23:59:18.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.233+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a01dd0b0 con 0x7fe4a0072620 2024-03-23T23:59:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.234+0000 7fe497e00640 1 -- 172.21.15.31:0/34494500 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe48801a070 con 0x7fe4a0072620 2024-03-23T23:59:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.235+0000 7fe497e00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe47c06bc00 0x7fe47c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T23:59:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.235+0000 7fe497e00640 1 -- 172.21.15.31:0/34494500 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5516+0+0 (secure 0 0 0) 0x7fe48808a990 con 0x7fe4a0072620 2024-03-23T23:59:18.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.236+0000 7fe49fe00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe47c06bc00 0x7fe47c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T23:59:18.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.237+0000 7fe49fe00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe47c06bc00 0x7fe47c06e0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe490036000 tx=0x7fe490008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T23:59:18.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.240+0000 7fe497e00640 1 -- 172.21.15.31:0/34494500 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185025 (secure 0 0 0) 0x7fe4a00b1770 con 0x7fe4a0072620 2024-03-23T23:59:18.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.441+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe4a013d070 con 0x7fe4a0072620 2024-03-23T23:59:18.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.971+0000 7fe497e00640 1 -- 172.21.15.31:0/34494500 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe4a013d070 con 0x7fe4a0072620 2024-03-23T23:59:18.972 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-03-23T23:59:18.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe47c06bc00 msgr2=0x7fe47c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:18.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe47c06bc00 0x7fe47c06e0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe490036000 tx=0x7fe490008030 comp rx=0 tx=0).stop 2024-03-23T23:59:18.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a0072620 msgr2=0x7fe4a01404d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T23:59:18.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a0072620 0x7fe4a01404d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe48800ebe0 tx=0x7fe48800c520 comp rx=0 tx=0).stop 2024-03-23T23:59:18.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 shutdown_connections 2024-03-23T23:59:18.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:6832/794111806,v1:172.21.15.59:6833/794111806] conn(0x7fe47c06bc00 0x7fe47c06e0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a00b7f10 0x7fe4a0140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4a0072620 0x7fe4a01404d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 --2- 172.21.15.31:0/34494500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4a0071bb0 0x7fe4a01dd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T23:59:18.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.975+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 >> 172.21.15.31:0/34494500 conn(0x7fe4a0067220 msgr2=0x7fe4a00b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T23:59:18.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.976+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 shutdown_connections 2024-03-23T23:59:18.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-03-23T23:59:18.976+0000 7fe4a5a00640 1 -- 172.21.15.31:0/34494500 wait complete. 2024-03-23T23:59:19.003 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-23T23:59:19.003 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-23T23:59:19.003 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.023 INFO:tasks.ceph.mds.a:Stopped 2024-03-23T23:59:19.024 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-23T23:59:19.024 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.040 INFO:tasks.ceph.mds.b:Stopped 2024-03-23T23:59:19.041 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-23T23:59:19.041 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-23T23:59:19.041 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.124 INFO:tasks.ceph.osd.0:Stopped 2024-03-23T23:59:19.125 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-23T23:59:19.125 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.172 INFO:tasks.ceph.osd.1:Stopped 2024-03-23T23:59:19.173 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-23T23:59:19.173 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.249 INFO:tasks.ceph.osd.2:Stopped 2024-03-23T23:59:19.249 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-23T23:59:19.249 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.306 INFO:tasks.ceph.osd.3:Stopped 2024-03-23T23:59:19.307 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-23T23:59:19.307 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.377 INFO:tasks.ceph.osd.4:Stopped 2024-03-23T23:59:19.377 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-23T23:59:19.377 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.442 INFO:tasks.ceph.osd.5:Stopped 2024-03-23T23:59:19.443 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-23T23:59:19.443 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.510 INFO:tasks.ceph.osd.6:Stopped 2024-03-23T23:59:19.510 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-23T23:59:19.510 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.565 INFO:tasks.ceph.osd.7:Stopped 2024-03-23T23:59:19.565 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-23T23:59:19.565 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-23T23:59:19.566 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:19.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-03-23T23:59:25.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~6s 2024-03-23T23:59:25.668 INFO:tasks.ceph.mgr.y:Stopped 2024-03-23T23:59:25.668 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-23T23:59:25.668 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:25.744 INFO:tasks.ceph.mgr.x:Stopped 2024-03-23T23:59:25.744 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-23T23:59:25.745 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T23:59:25.745 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:25.795 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T23:59:25.796 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T23:59:25.796 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:25.838 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T23:59:25.838 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T23:59:25.839 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T23:59:25.864 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T23:59:25.865 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-23T23:59:25.865 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-23T23:59:25.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:59:25.976 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-23T23:59:26.182 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:59:26.182 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-23T23:59:26.364 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:59:26.364 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-23T23:59:26.525 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:59:26.526 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-23T23:59:26.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:59:26.747 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-23T23:59:27.230 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:59:27.230 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-23T23:59:27.377 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:59:27.378 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-23T23:59:27.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:59:27.534 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-23T23:59:27.713 INFO:tasks.ceph:Archiving mon data... 2024-03-23T23:59:27.715 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/data/mon.a.tgz 2024-03-23T23:59:27.715 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-03-23T23:59:27.774 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.NutLiApxRU 2024-03-23T23:59:27.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NutLiApxRU 2024-03-23T23:59:27.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.NutLiApxRU 2024-03-23T23:59:28.110 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.NutLiApxRU is 266KB 2024-03-23T23:59:28.220 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.NutLiApxRU 2024-03-23T23:59:28.277 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/data/mon.b.tgz 2024-03-23T23:59:28.277 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-03-23T23:59:28.336 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.RhTiX16f8g 2024-03-23T23:59:28.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RhTiX16f8g 2024-03-23T23:59:28.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.RhTiX16f8g 2024-03-23T23:59:28.685 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.RhTiX16f8g is 362KB 2024-03-23T23:59:28.798 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.RhTiX16f8g 2024-03-23T23:59:28.856 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/data/mon.c.tgz 2024-03-23T23:59:28.856 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-03-23T23:59:28.910 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.nLI6c7hHrf 2024-03-23T23:59:28.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.nLI6c7hHrf 2024-03-23T23:59:29.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.nLI6c7hHrf 2024-03-23T23:59:29.246 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.nLI6c7hHrf is 362KB 2024-03-23T23:59:29.360 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.nLI6c7hHrf 2024-03-23T23:59:29.416 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-23T23:59:29.417 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-23T23:59:29.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-23T23:59:29.582 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-23T23:59:29.642 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-23T23:59:29.642 INFO:tasks.ceph:Archiving crash dumps... 2024-03-23T23:59:29.644 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/remote/smithi031/crash 2024-03-23T23:59:29.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-23T23:59:29.749 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/remote/smithi059/crash 2024-03-23T23:59:29.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-23T23:59:29.849 INFO:tasks.ceph:Shutting down logrotate 2024-03-23T23:59:29.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:29.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:29.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:30.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-23T23:59:30.201 INFO:tasks.ceph:Compressing logs... 2024-03-23T23:59:30.202 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-23T23:59:30.210 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-23T23:59:30.301 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43110.log 2024-03-23T23:59:30.302 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42176.log 2024-03-23T23:59:30.303 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45448.log 2024-03-23T23:59:30.304 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-23T23:59:30.305 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43110.log.gz 2024-03-23T23:59:30.305 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2024-03-23T23:59:30.305 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42176.log.gz 2024-03-23T23:59:30.306 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37058.log 2024-03-23T23:59:30.306 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45448.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45448.log.gz 2024-03-23T23:59:30.307 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31013.log 2024-03-23T23:59:30.308 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43097.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-23T23:59:30.308 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2024-03-23T23:59:30.308 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.31013.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31013.log.gz 2024-03-23T23:59:30.308 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-03-23T23:59:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-23T23:59:30.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37058.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-23T23:59:30.309 INFO:teuthology.orchestra.run.smithi059.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37058.log.gz 2024-03-23T23:59:30.310 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36978.log 2024-03-23T23:59:30.310 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-23T23:59:30.311 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45532.log 2024-03-23T23:59:30.311 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2024-03-23T23:59:30.311 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-03-23T23:59:30.312 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43111.log 2024-03-23T23:59:30.312 INFO:teuthology.orchestra.run.smithi059.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-23T23:59:30.312 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36978.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36978.log.gz 2024-03-23T23:59:30.313 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36898.log 2024-03-23T23:59:30.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-03-23T23:59:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36858.log 2024-03-23T23:59:30.314 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36898.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36898.log.gz 2024-03-23T23:59:30.315 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45532.log.gz 2024-03-23T23:59:30.315 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43446.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz -5 2024-03-23T23:59:30.315 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42777.log 2024-03-23T23:59:30.315 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46238.log 2024-03-23T23:59:30.316 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43111.log.gz 2024-03-23T23:59:30.316 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2024-03-23T23:59:30.316 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42777.log.gz 2024-03-23T23:59:30.317 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46238.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46238.log.gzgzip 2024-03-23T23:59:30.317 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2024-03-23T23:59:30.318 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43898.log 2024-03-23T23:59:30.318 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37018.log 2024-03-23T23:59:30.318 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36858.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-23T23:59:30.319 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36858.log.gz 2024-03-23T23:59:30.319 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37018.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-23T23:59:30.319 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37018.log.gz 2024-03-23T23:59:30.320 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37142.log 2024-03-23T23:59:30.321 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2024-03-23T23:59:30.321 INFO:teuthology.orchestra.run.smithi031.stderr:gzip/var/log/ceph/ceph-client.admin.46010.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2024-03-23T23:59:30.321 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2024-03-23T23:59:30.321 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42218.log 2024-03-23T23:59:30.321 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43898.log.gz 2024-03-23T23:59:30.321 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42512.log 2024-03-23T23:59:30.322 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2024-03-23T23:59:30.323 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36938.log 2024-03-23T23:59:30.324 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37142.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-23T23:59:30.324 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37142.log.gz 2024-03-23T23:59:30.324 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-03-23T23:59:30.324 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42218.log.gz 2024-03-23T23:59:30.324 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43438.log 2024-03-23T23:59:30.324 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42512.log.gz 2024-03-23T23:59:30.325 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36938.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36938.log.gz 2024-03-23T23:59:30.326 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42554.log 2024-03-23T23:59:30.326 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-03-23T23:59:30.326 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46052.log 2024-03-23T23:59:30.326 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43438.log.gz 2024-03-23T23:59:30.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-23T23:59:30.328 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42554.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42554.log.gz 2024-03-23T23:59:30.328 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45196.log 2024-03-23T23:59:30.328 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42766.log 2024-03-23T23:59:30.328 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46052.log.gz 2024-03-23T23:59:30.329 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-23T23:59:30.329 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45700.log 2024-03-23T23:59:30.330 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45196.log.gz 2024-03-23T23:59:30.330 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42766.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42766.log.gz 2024-03-23T23:59:30.331 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-03-23T23:59:30.331 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-03-23T23:59:30.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-23T23:59:30.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37098.log 2024-03-23T23:59:30.333 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45700.log.gz 2024-03-23T23:59:30.333 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2024-03-23T23:59:30.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-23T23:59:30.335 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-03-23T23:59:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43814.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-03-23T23:59:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43450.log 2024-03-23T23:59:30.335 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-03-23T23:59:30.335 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2024-03-23T23:59:30.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37098.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37098.log.gz 2024-03-23T23:59:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41878.log 2024-03-23T23:59:30.337 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43450.log.gz 2024-03-23T23:59:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44210.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-03-23T23:59:30.337 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2024-03-23T23:59:30.338 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2024-03-23T23:59:30.338 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41878.log.gz 2024-03-23T23:59:30.339 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-03-23T23:59:30.340 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43102.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2024-03-23T23:59:30.340 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-03-23T23:59:30.341 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43445.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-23T23:59:30.342 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2024-03-23T23:59:30.342 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41962.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-03-23T23:59:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36822.log 2024-03-23T23:59:30.343 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45028.log 2024-03-23T23:59:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36822.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.36822.log.gz 2024-03-23T23:59:30.345 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-23T23:59:30.345 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43109.log 2024-03-23T23:59:30.346 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42776.log 2024-03-23T23:59:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45028.log: /var/log/ceph/ceph-client.admin.43109.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45028.log.gz 2024-03-23T23:59:30.350 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43109.log.gz 2024-03-23T23:59:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41836.log 2024-03-23T23:59:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-03-23T23:59:30.350 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42776.log.gz 2024-03-23T23:59:30.350 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41836.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41836.log.gz 2024-03-23T23:59:30.351 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43442.log 2024-03-23T23:59:30.351 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42386.log 2024-03-23T23:59:30.352 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-03-23T23:59:30.352 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43442.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43442.log.gz 2024-03-23T23:59:30.352 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45070.log 2024-03-23T23:59:30.353 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2024-03-23T23:59:30.354 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42386.log.gz 2024-03-23T23:59:30.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45070.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45070.log.gz 2024-03-23T23:59:30.355 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2024-03-23T23:59:30.355 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42302.log 2024-03-23T23:59:30.356 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz 2024-03-23T23:59:30.357 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46094.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2024-03-23T23:59:30.357 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45784.log 2024-03-23T23:59:30.358 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2024-03-23T23:59:30.358 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42302.log.gz 2024-03-23T23:59:30.359 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45784.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45784.log.gz 2024-03-23T23:59:30.359 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37076.log 2024-03-23T23:59:30.360 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41616.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-23T23:59:30.360 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2024-03-23T23:59:30.361 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37076.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37076.log.gz 2024-03-23T23:59:30.361 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-03-23T23:59:30.362 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-03-23T23:59:30.364 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43688.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-03-23T23:59:30.364 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42470.log 2024-03-23T23:59:30.365 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44126.log 2024-03-23T23:59:30.366 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42134.log: /var/log/ceph/ceph-client.admin.42470.log: gzip 87.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.42470.log.gz --verbose 2024-03-23T23:59:30.367 INFO:teuthology.orchestra.run.smithi031.stderr: -- /var/log/ceph/ceph-client.admin.45280.log 2024-03-23T23:59:30.367 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-03-23T23:59:30.367 INFO:teuthology.orchestra.run.smithi031.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2024-03-23T23:59:30.368 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42090.log 2024-03-23T23:59:30.368 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44126.log.gz 2024-03-23T23:59:30.369 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-03-23T23:59:30.369 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2024-03-23T23:59:30.369 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42090.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42090.log.gz 2024-03-23T23:59:30.370 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-23T23:59:30.371 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43448.log 2024-03-23T23:59:30.371 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-03-23T23:59:30.372 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45112.log 2024-03-23T23:59:30.373 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43448.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43448.log.gz 2024-03-23T23:59:30.373 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2024-03-23T23:59:30.374 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43113.log 2024-03-23T23:59:30.376 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45112.log: /var/log/ceph/ceph-client.admin.45742.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45112.log.gz 2024-03-23T23:59:30.376 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz 2024-03-23T23:59:30.376 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43436.log 2024-03-23T23:59:30.377 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-03-23T23:59:30.377 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43113.log.gz 2024-03-23T23:59:30.378 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43436.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43436.log.gz 2024-03-23T23:59:30.378 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43982.log 2024-03-23T23:59:30.379 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42775.log 2024-03-23T23:59:30.380 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.c.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-23T23:59:30.381 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45616.log: /var/log/ceph/ceph-client.admin.43982.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-03-23T23:59:30.381 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43982.log.gz 2024-03-23T23:59:30.381 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45322.log 2024-03-23T23:59:30.382 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2024-03-23T23:59:30.382 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42775.log: /var/log/ceph/ceph-client.admin.45322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42775.log.gz 2024-03-23T23:59:30.383 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45322.log.gz 2024-03-23T23:59:30.383 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2024-03-23T23:59:30.384 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-23T23:59:30.384 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45886.log: /var/log/ceph/ceph-client.admin.44294.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz 2024-03-23T23:59:30.385 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43730.log 2024-03-23T23:59:30.385 INFO:teuthology.orchestra.run.smithi031.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2024-03-23T23:59:30.386 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41689.log 2024-03-23T23:59:30.388 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43730.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43730.log.gz 2024-03-23T23:59:30.388 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42596.log 2024-03-23T23:59:30.389 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43416.log 2024-03-23T23:59:30.390 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41689.log: /var/log/ceph/ceph-client.admin.42596.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41689.log.gz 2024-03-23T23:59:30.390 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44168.log 2024-03-23T23:59:30.390 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42596.log.gz 2024-03-23T23:59:30.391 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46196.log 2024-03-23T23:59:30.392 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43416.log.gz 2024-03-23T23:59:30.393 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44168.log: 93.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-23T23:59:30.393 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44168.log.gz 2024-03-23T23:59:30.393 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45364.log 2024-03-23T23:59:30.394 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42260.log 2024-03-23T23:59:30.394 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46196.log: /var/log/ceph/ceph-client.admin.45364.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46196.log.gz 2024-03-23T23:59:30.395 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45364.log.gz 2024-03-23T23:59:30.395 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44944.log 2024-03-23T23:59:30.396 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-23T23:59:30.397 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42260.log: /var/log/ceph/ceph-client.admin.44944.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42260.log.gz 2024-03-23T23:59:30.397 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44944.log.gz 2024-03-23T23:59:30.397 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43100.log 2024-03-23T23:59:30.398 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.0.log: -- /var/log/ceph/ceph-client.admin.45238.log 2024-03-23T23:59:30.399 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43100.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43100.log.gz 2024-03-23T23:59:30.400 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45968.log 2024-03-23T23:59:30.401 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2024-03-23T23:59:30.401 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-03-23T23:59:30.402 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2024-03-23T23:59:30.402 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45968.log.gz 2024-03-23T23:59:30.403 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42344.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-23T23:59:30.403 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2024-03-23T23:59:30.404 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43856.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2024-03-23T23:59:30.405 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45844.log 2024-03-23T23:59:30.405 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43772.log 2024-03-23T23:59:30.407 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45844.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-23T23:59:30.407 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45844.log.gz 2024-03-23T23:59:30.407 INFO:teuthology.orchestra.run.smithi031.stderr: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-23T23:59:30.408 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.43772.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43772.log.gz 2024-03-23T23:59:30.408 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44252.log 2024-03-23T23:59:30.409 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2024-03-23T23:59:30.411 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.44252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42778.log 2024-03-23T23:59:30.411 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44252.log.gz 2024-03-23T23:59:30.412 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42765.log 2024-03-23T23:59:30.412 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2024-03-23T23:59:30.413 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42778.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42778.log.gz 2024-03-23T23:59:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-03-23T23:59:30.414 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42765.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42765.log.gz 2024-03-23T23:59:30.415 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42004.log 2024-03-23T23:59:30.416 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45490.log/var/log/ceph/ceph-client.admin.45926.log: 2024-03-23T23:59:30.417 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2024-03-23T23:59:30.417 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2024-03-23T23:59:30.418 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42004.log.gz 2024-03-23T23:59:30.419 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45406.log 2024-03-23T23:59:30.419 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45490.log.gz 2024-03-23T23:59:30.420 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42046.log 2024-03-23T23:59:30.420 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2024-03-23T23:59:30.421 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45406.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45406.log.gz 2024-03-23T23:59:30.422 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44986.log 2024-03-23T23:59:30.422 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42046.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42046.log.gz 2024-03-23T23:59:30.423 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-03-23T23:59:30.424 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45154.log 2024-03-23T23:59:30.425 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.44986.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44986.log.gz 2024-03-23T23:59:30.426 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.46154.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-23T23:59:30.426 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-03-23T23:59:30.427 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.45154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-03-23T23:59:30.427 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45154.log.gz 2024-03-23T23:59:30.428 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42771.log 2024-03-23T23:59:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37190.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-23T23:59:30.430 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-03-23T23:59:30.430 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.42771.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42771.log.gz 2024-03-23T23:59:30.431 INFO:teuthology.orchestra.run.smithi059.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-23T23:59:30.460 INFO:teuthology.orchestra.run.smithi059.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-23T23:59:30.462 INFO:teuthology.orchestra.run.smithi059.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-23T23:59:30.468 INFO:teuthology.orchestra.run.smithi059.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-23T23:59:30.505 INFO:teuthology.orchestra.run.smithi059.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-23T23:59:30.516 INFO:teuthology.orchestra.run.smithi031.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-23T23:59:30.533 INFO:teuthology.orchestra.run.smithi031.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-23T23:59:30.534 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-23T23:59:30.540 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-23T23:59:30.559 INFO:teuthology.orchestra.run.smithi031.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-23T23:59:30.569 INFO:teuthology.orchestra.run.smithi059.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-23T23:59:30.574 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-03-23T23:59:30.574 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m0.313s 2024-03-23T23:59:30.575 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m1.153s 2024-03-23T23:59:30.575 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.229s 2024-03-23T23:59:30.586 INFO:teuthology.orchestra.run.smithi031.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-23T23:59:30.591 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-03-23T23:59:30.591 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m0.333s 2024-03-23T23:59:30.591 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m0.906s 2024-03-23T23:59:30.592 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.427s 2024-03-23T23:59:30.592 INFO:tasks.ceph:Archiving logs... 2024-03-23T23:59:30.593 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/remote/smithi031/log 2024-03-23T23:59:30.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-23T23:59:30.864 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/remote/smithi059/log 2024-03-23T23:59:30.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-23T23:59:31.097 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-23T23:59:31.107 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-23T23:59:31.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-23T23:59:31.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-23T23:59:31.281 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-23T23:59:31.290 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-23T23:59:31.290 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T23:59:31.298 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T23:59:31.347 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: ntpq: command not found 2024-03-23T23:59:31.354 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-03-23T23:59:31.357 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T23:59:31.357 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2024-03-23T23:59:31.358 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 -127us[ -126us] +/- 82ms 2024-03-23T23:59:31.358 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -885us[ -884us] +/- 67ms 2024-03-23T23:59:31.358 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +1287us[+1287us] +/- 85ms 2024-03-23T23:59:31.358 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:59:31.365 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T23:59:31.365 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-03-23T23:59:31.365 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 23 -127us[ -127us] +/- 82ms 2024-03-23T23:59:31.365 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -899us[ -876us] +/- 67ms 2024-03-23T23:59:31.365 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +1282us[+1282us] +/- 85ms 2024-03-23T23:59:31.365 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T23:59:31.367 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-23T23:59:31.376 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-23T23:59:31.376 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-23T23:59:31.397 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-23T23:59:31.621 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-23T23:59:31.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-23T23:59:31.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:59:31.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-23T23:59:32.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:59:32.057 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-23T23:59:32.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-23T23:59:32.107 INFO:teuthology.task.internal:Duration was 804.449211 seconds 2024-03-23T23:59:32.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-23T23:59:32.140 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-23T23:59:32.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-23T23:59:32.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-23T23:59:32.322 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T23:59:32.325 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T23:59:32.795 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-23T23:59:32.795 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-03-23T23:59:32.796 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-23T23:59:32.859 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-03-23T23:59:32.859 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-23T23:59:32.925 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-23T23:59:32.926 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-23T23:59:32.931 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-23T23:59:33.002 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-23T23:59:33.002 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-23T23:59:33.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-23T23:59:33.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-23T23:59:33.172 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-23T23:59:33.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-23T23:59:33.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-23T23:59:33.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-23T23:59:33.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-23T23:59:33.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-23T23:59:33.504 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-03-23T23:59:33.508 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-03-23T23:59:33.581 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-23T23:59:33.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:59:33.634 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-23T23:59:33.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:59:33.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-23T23:59:33.701 INFO:teuthology.task.internal:Transferring archived files... 2024-03-23T23:59:33.702 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/remote/smithi031 2024-03-23T23:59:33.702 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-23T23:59:33.813 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414/remote/smithi059 2024-03-23T23:59:33.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-23T23:59:33.925 INFO:teuthology.task.internal:Removing archive directory... 2024-03-23T23:59:33.925 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-23T23:59:33.933 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-23T23:59:33.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-23T23:59:34.002 INFO:teuthology.task.internal:Not uploading archives. 2024-03-23T23:59:34.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-23T23:59:34.032 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-23T23:59:34.032 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-23T23:59:34.040 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-23T23:59:34.094 INFO:teuthology.orchestra.run.smithi031.stdout: 393229 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 23 23:59 /home/ubuntu/cephtest 2024-03-23T23:59:34.094 INFO:teuthology.orchestra.run.smithi031.stdout: 526049 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 23 23:56 /home/ubuntu/cephtest/mnt.0 2024-03-23T23:59:34.094 INFO:teuthology.orchestra.run.smithi031.stdout: 526050 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 23 23:58 /home/ubuntu/cephtest/mnt.0/client.0 2024-03-23T23:59:34.094 INFO:teuthology.orchestra.run.smithi031.stdout: 540313 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 23 23:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-23T23:59:34.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T23:59:34.097 INFO:teuthology.orchestra.run.smithi031.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-03-23T23:59:34.097 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi031 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-23T23:59:34.107 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-23T23:59:34.118 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-23T23:59:34.141 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi031 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-23T23:59:34.142 INFO:teuthology.nuke:Checking targets against current locks 2024-03-23T23:59:34.150 INFO:teuthology.orchestra.run.smithi059.stdout: 395173 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 23 23:59 /home/ubuntu/cephtest 2024-03-23T23:59:34.182 DEBUG:teuthology.nuke:shortname: smithi031 2024-03-23T23:59:34.183 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-23T23:59:34.206 DEBUG:teuthology.nuke:shortname: smithi059 2024-03-23T23:59:34.206 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-23T23:59:34.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:35:47.590605', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK4lwNX5QNvT+pyLOZV5EIjD1xOiWfDXLXOaViQ6vqUR514pjgAXowOqHA9uB83z9/u0NNnRcdYmfBwQWWSuaiA='} 2024-03-23T23:59:34.230 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 23:35:47.592425', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwSqqx5Cmv0r6+LNQpDN2JYWJ+7vWjx9kOmMGrUozalGrHbQGtQzNhDMsWkK0qDLABIubMln60gk+mcLAf8qfU='} 2024-03-23T23:59:34.262 INFO:teuthology.orchestra.console.smithi031:Power off 2024-03-23T23:59:34.262 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-23T23:59:34.285 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2024-03-23T23:59:34.285 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T23:59:34.303 INFO:teuthology.orchestra.console.smithi059:Power off 2024-03-23T23:59:34.304 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-23T23:59:34.313 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-03-23T23:59:34.325 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-03-23T23:59:34.325 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T23:59:34.346 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-23T23:59:38.314 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T23:59:38.347 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T23:59:38.424 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-03-23T23:59:38.457 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-03-23T23:59:42.427 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T23:59:42.458 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T23:59:42.537 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-03-23T23:59:42.568 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-03-23T23:59:42.638 INFO:teuthology.orchestra.console.smithi031:Power off completed 2024-03-23T23:59:42.669 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-03-23T23:59:42.775 INFO:teuthology.run:Summary data: description: fs/libcephfs/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} duration: 804.449211359024 failure_reason: 'Command failed (workunit test client/test.sh) on smithi031 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3be9a5c9bc793e11e2800a8c0c696e8b46742033 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh''' flavor: default mon.a-kernel-sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 mon.b-kernel-sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=68e730414239455aab0fcde96e8932b1 status: fail success: false 2024-03-23T23:59:42.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T23:59:42.874 INFO:teuthology.run:FAIL